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^ Abstract 

In this work, we derive achievable rate regions for the three-user interference channels with asymmetric trans- 

mitter cooperation and various decoding capabilities at the receivers. The three-user channel faciUtates different 

t/3 ways of message sharing between the transmitters. We introduce two natural ways of extending the concept of 

O 

' unidirectional message sharing from two users to three users - (i) cumulative message sharing and (ii) primary-only 

message sharing. In addition, we define several cognitive interference channels based on the decoding capability of 
the receivers. We employ a coding technique, which is a combination of superposition and Gel'fand-Pinsker coding 
techniques, to derive an achievable rate region for each of the cognitive interference channels. Simulation results, by 
considering the Gaussian channel case, enables a visual comparison of the two message-sharing schemes considered 
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H I. Introduction 

Most of the current wireless system designs are primarily based on the idea of avoiding interference between 
users in a given frequency band. This has resulted in an inefficient use of the Radio Frequency (RF) spectrum, which 
can only be mitigated by introducing some form of cooperation between the users. Cognitive Radio (CR) [1] has 
recently emerged as a possible solution to this bandwidth scarcity problem, as it tries to improve spectral efficiency 
by making the users aware of their RF environment and adjusting their transmission and reception parameters 
accordingly. An overview of the potential benefits offered by the CRs in physical layer research is provided in [2]. 
In [3], three main CR paradigms have been identified - underlay, overlay and interweave. In the underlay paradigm, 
the CR users are allowed to operate only if the noncognitive (or primary) users experience an interference (from 
the CR) which is below a certain threshold. While operating in the overlay paradigm, the CRs transmit their data 



in this paper. It also provides useful insights into the effect of message-splitting at the transmitters and the decoding 
capability of the receivers on the achievable rates. 
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simultaneously with the noncognitive users by employing sophisticated techniques that maintain or even improve 
the performance of the noncognitive users. In the interweave paradigm, the CRs sense unused frequency bands 
called spectrum holes to communicate without disrupting the primary transmissions. Of these, the information 
theoretic research has focussed primarily on the overlay paradigm with transmitter cooperation introduced through 
unidirectional message sharing. Here the primary user non-causally shares the message it intends to transmit with 
the cognitive user. Then, the primary and cognitive users simultaneously transmit their messages, but the encoding 
is performed in such a way that the the primary user does not suffer in terms of its achievable rates. 

We now present a short survey of recent information theoretic work in this area, followed by a summary of our 
contributions. 

A. Literature survey 

The concept of cognitive radios has spurred great deal of research in information theory, in addition to other fields 
such as signal processing and estimation/detection theory. A recent overview, identifying the three CR paradigms 
mentioned above, and exploring some of the fundamental capacity limits and associated transmission strategies for 
wireless networks is [3]. In [4], [5], Devroye et al defined the genie-aided CR channel and derive an achievable 
rate region. The coding scheme comprised a combination of the scheme proposed by Han and Kobayashi for the 
interference channel [6], and the one proposed by Gel'fand and Pinsker for channels with side information [7]. Both 
senders split their messages such that one of the sub-messages is decodable by the non-pairing receiver. Since the CR 
knows the sub-messages and the corresponding codewords of the primary sender, it applies Gel'fand-Pinsker (GP) 
coding to encode its own sub-messages by treating the codewords of the primary sender as known interference. In 
[8], Wu et al introduced terms like dumb and smart antennas to refer to primary and cognitive senders, respectively. 
They employed a combination of GP and superposition coding [9] techniques to come up with an achievable rate 
region for the two-user CR channel where neither sender spHts their messages, nor do the receivers decode the 
messages from the non-pairing senders. In [20], an achievable rate region for the two-user interference channel with 
degraded message sets has been derived by employing a coding scheme which is a combination of superposition 
and GP coding techniques. 

In [10], Jovicic et al presented the Gaussian CR channel and model the problem such that the primary sender is 
oblivious to the presence of the CR. Further, the primary receiver uses a single user decoder, just as it would in the 
absence of the CR. They employed dirty paper (DP) coding [11] to derive an achievable rate region. In [12], Marie 
et al determined the capacity region for interference channels with partially cooperating transmitters, by considering 
the strong interference regime in which both receivers decode both messages. In [13], inner and outer bounds on the 
capacity region of two-sender, two-receiver interference channels where one transmitter knows both the messages 
were estabUshed. The decoders were assumed to only decode messages from their intended senders. In [14] - [16], 
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information theoretic results for interference channels with common information were derived. The sum-capacity 
of the Gaussian MIMO cognitive radio network was presented in [17], and the results obtained apply to the single- 
antenna CR channel as well. Capacity scaling laws for CR networks were presented in [18], while achievable rates 
for channels with different states known non-causally to the encoder were considered in [19]. Interference channels 
with cognitive and partially-cognitive transmitters were considered in [21] - [23]. Results for strong interference 
channels with unidirectional cooperation were presented in [24], while [25] and [26] considered strong interference 
channels with common information. Multiple access channels with conferencing encoders are considered in [27], 
while [28] presented the capacity region of the Gaussian multiple access channel with conferencing encoders. The 
capacity region of the three-user multiple access channel with cooperation was presented in [29]. 

B. Contributions of this paper 

In this paper, we consider the case of three-user CR interference channel. The three-user channel facilitates 
different ways of transmitter cooperation, based on the message-sharing mechanism of the senders. We consider 
two natural ways of extending the two-user unidirectional message sharing paradigm to the three-user case, which 
we term (i) cumulative message sharing (CMS) and (ii) primary-only message sharing (PMS) (these notions will 
be made precise in the next section). 

Also, based on the decoding capabiUty of receivers, we define four cognitive channel models with CMS and 
PMS. We employ a known coding scheme which comprises a combination of GP coding [7] and superposition 
coding [9] techniques to derive an achievable rate region for each of the four channels. The coding scheme we 
adopt was first presented in [20] for the two-user case, and is extended here for the three-user CR channel. Initial 
results of this work have appeared in [30] and [31]. 

By deriving the rate regions under different message sharing and decoding-capabiUty assumptions, we illustrate 
the generality of the techniques employed here, and are able to glean useful insights into the rate regions and 
their characterization. Next, we speciaHze the achievable rate regions to the Gaussian channel, which enables us to 
compare the different rate regions both analytically and through simulations. We are able to make several interesting 
observations on the influence of message sharing and decoding capability assumptions on the achievable rates. 

The rest of the paper is organized as follows. In Section II, we introduce the discrete memoryless channel models 
for CMS and PMS, and lay down the notation used in the paper. We also present the probabiUty distribution 
functions characterizing these channels. In Section m, we present the achievability theorem for the channel models 
considered and work out the details of the proof for two of the channel models. In Section IV, we consider the 
Gaussian channel model and construct the framework for numerical evaluation. Simulation results and related 
discussions are presented in Section V. We conclude the paper in Section VI. The achievable rate region equations 
for the four discrete memoryless channels considered in this paper and the proof of achievabiUty theorem for one 
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channel model is relegated to the Appendix. 

II. Discrete Memoryless Channel Model and Preliminaries 

A schematic diagram of CMS and PMS is shown in Fig. 1. In the case of CMS, the first cognitive radio (CRi) 
has noncausal knowledge of the message mi and the corresponding codewords of the primary sender. The second 
cognitive radio (CR2) has noncausal knowledge of the message mi of the primary transmitter as well as the 
message m2 of CRi, and their respective codewords. In the case of PMS, both the cognitive radios CRi and CR2 
have noncausal knowledge of the message mi and the corresponding codewords of the primary sender. There is no 
message-sharing mechanism between the cognitive radios themselves. For the two-user case, both CMS and PMS 
reduce to the models employed in the existing literature. 

The three-user discrete memoryless cognitive interference channel is described by (^^i, ^^2, '^3, 7^, 3^1,3^2, 3^3). 
We define two channels with CMS and PMS. For A; = 1, 2, 3, 

• the senders and receivers are denoted by Sk and TZk, respectively, 

• finite sets and denote the channel input and output alphabets, respectively, 

• random variables G Xf^ and 1^ G yk are the inputs and outputs of the channel, respectively and 

• V denotes the finite set of conditional probabihties p (2/1,2/2, y3\xi,X2, X3), when {xi,X2, xs) G A'l x A2 x A3 
are transmitted and (2/1,2/2, 2/3) G 3^1 x 3^2 x 3^3 are obtained by the receivers. 

The channels are assumed to be memoryless. In the usual three-user interference channel, the messages at the senders 
are given by nik G Aik = {1, ...,Mfc}; being finite set with elements. The messages are assumed to be 
independently generated. For an interference channel having asymmetric transmitter cooperation with cumulative 
message sharing. Si has message mi, S2 has messages (mi,m2), and S3 has messages (mi,m2,m3). For an 
interference channel having asymmetric transmitter cooperation with primary-only message sharing. Si has message 
mi, S2 has messages (mi,m2), and <S3 has messages (mi,m3). An (Mi, M2, M3, n, Pi'*^) code exists for these 
channels, if there exists the following encoding functions: 

fi: Mi^ X^, f[: Mi^ 

/2 : TWi X 7W2 ^ X.^\ f^: Mi x M2 ^ 
h - TWi X A42 X 7W3 ^ X^, : MixMz^ X^ 

and the following decoding functions: 

gi ■ 3^1" ^ Ml, g'l ■ 3^f ^ Mi, 

92 ■ ^ M2, g'2 : 3^2" ^ M2, 

93 : yS ^ M3, 93 ■■ yS ^ M3, 



such that the decoding error probability maxiP^"^^ ,P^'^j ,P^^j} is < P^^ P^^^ is the average probabihty of 
decoding error computed using: 

■^S^ " M M M ^ PirrikT^ mfc|(mi, ma, mg) sent] ; A; = 1, 2, 3. 

fk (or (/fc) correspond to the encoders (or decoders) used by channels with CMS, while (or g'j^) correspond to 
the encoders (or decoders) used by channels with PMS. 

We define two channels denoted C*^^ (cms for cumulative message sharing) and two channels denoted 
(pms for primary-only message sharing); t = 1, 2. A non-negative rate triple (i?i, i?2, ^3) is achievable for each of 
the channels C*^^ and C*„^, if for any < Pi"^ < 1 there exists a (2^"^!! , 2^"^=! ^2^^^^'^ , n, P]"^) code such that 
Pe^^ ^ as n ^ 00. The capacity region for the channels C^cms ^^'^ ^pms is the closure of the set of all achievable 
rate triples (Pi,P2,P3)- A subset of the capacity region gives an achievable rate region. 

As in [6], we will modify the channels Cj^g and C^g] t = 1,2 to introduce rate sphtting. To motivate the 
discussion, consider the two-user scenario. Han and Kobayashi [6] showed that the achievable rate region of the 
interference channel can be improved using message splitting, where each user splits its message into two parts. 
Given that all parts of the message need to be decodable at the intended receiver, this splitting is exhaustive: either 
the part of the message is decodable at the non-intended receiver, or not. In the three user case, more options 
exist. For example, consider the message sphtting at the primary user. It can split its message into four parts: one 
decodable at both the cognitive receivers, one decodable at CRi but not at CR2, one decodable at CR2 but not at 
CRi, and finally, one that is not decodable at either CR receiver (i.e., decodable only at the primary receiver). This 
implies a total of 12 message parts, and the rate region obtained by considering all these possible message splittings 
would be the largest possible one. Now, each receiver can decode 8 messages, four from its own transmitter and 
four from the two other transmitters. Of these 8 messages, the receiver is only required to decode four messages 
correctly, i.e., error events where only the unwanted messages are received in error does not affect the rate region. 
Thus, out of the possible 2^ — 1 events where one or more of the 8 messages are received in error, 2^ — 1 events 
corresponding to one or more of the unintended messages being received in error (and the intended messages being 
received correctly) do not count towards the rate region description. Therefore, the rate region description would 
involve (2^ - 1) - (2^^ - 1) = 240 inequalities per receiver, and thus, we would have 720 inequalities in total. Since 
working out such a rate region would be an arduous task, we make some simplifying assumptions. 

In each channel model, we spht the message at each transmitter into only two instead of four parts. In C^^^ and 
^pms' one part of the message is decodable only at the intended receiver, while the other part is decodable at all 
receivers. In C^^g and C'^„is, one part of the message is decodable only at the intended receiver, but the other part 
is decodable at the intended receiver and the primary receiver only. The reason for the choice of C^„js ^^'^ ^pms 
mainly to see the effect of allowing each user to decode part of other users' message to reduce the interference it sees. 
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It will turn out that unidirectional message sharing mainly benefits the secondary transmitters rather than the primary 
user, in terms of the achievable rate region. This can be mitigated by allowing the primary receiver to decoding part 
of the secondary transmitters' messages, as in C^^^^ and Cp„j^. The notation for describing the achievable rates of 
these sub-messages and their respective description is tabulated in Table I. The decoding capability of receivers for 
the channels C*^^; t = 1,2 is summarized in Tables n and m, respectively. We also introduce auxiliary random 
variables defined on finite sets and tabulate them in Table IV. Depending on the decoding capabiUty of receivers, 
only a subset of these sub-messages, their corresponding rates, and the corresponding auxiliary random variables 
will be used to derive an achievable rate region for each channel model. Note that, we do not consider the practical 
aspects of underlying the physical realization of such models. Also, the computation of the exact capacity region 
is hard and is beyond the scope of this paper. In this paper, we explicitly show the modification for one channel 
(^cms)- Referring to the decoding capability of the receivers (see Table III), the messages at the three senders in 
the modified channel can be written as: 

Sender 1: mu G A^n = {!,..., Mn}, 
Sender 2: m2i G M21 = {1, M21}, m22 e M22 = {1, -,^22}, 
Sender 3: rnsi G M31 = {1, M31}, 77133 e M33 = {1, M33}, 

with all messages being defined on sets with finite number of elements. Please note that we do not split the message 
mi, but for consistency in notation we write mi as mu. Define an (Mn, M21, M22, M31, M33, n, Pi"^) code for the 
modified channel as a set of Mn codewords for Si, M11M21M22 codewords for S2, and M11M21M22M31M33 code- 
words for (S3 such that the average probability of decoding error is less than Pi"^ . Call a tuple {Ru, R21 , R22 , R31 , R33) 
achievable if there exists a sequence of (2^'^^"! , 2^''^^^^ ^ 2r"^==l ^2^''^^^^ , 2^''^^^'^ , n, Pi"^) codes such that P]"^ 
as n ^ 00. The capacity region for the modified channel is the closure of the set of all achievable rate tuples 
{Rii,R2i,R22,R3i,R33)- It can be shown that if the rate tuple (^11,^21,^22,^31,^33) is achievable for the 
modified channel, then the rate triple (Pii,P2i + ^22,^31 + P33) is achievable for the channel C^^g (see [6, 
Corollary 2.1]). In a similar fashion, we can modify all the channel models C*^^ and C*^^; t = 1,2. 

III. An Achievable Rate Region for the Channels 
Let Perns denote the set of all joint probability distributions Pcms(-); ^ = 1, 2 respectively, that factor as follows: 

plmsiQ^ '^0, wi,xi,uo, U2, X2, vq, V3, X3, yi,y2, 2/3) = 

p{q)p{wo, wi,xi\q)p{uo\wo, wi, q)p{u2\wo, wi,q) 

P{X2\U0, U2, Wo, Wi,q)p{vo\uo, U2, Wo, wi,q) 
P{V3\U0, U2,W0, Wl, q)p{x3\vo, V3, Uo, U2, wo, wi,q) 
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xp{yi,y2,y3\xi,x2,x3), (i) 

plms{Q^'l^^Xi,Ui,U2,X2,Vi,V3,X3,yi,y2,y3) = 

p{q)p{w, xi\q)p{ui\w, q)p{u2\w, q)p{x2\ui,U2,w, q) 

p{vi\ui,U2, W, q)p{v3\ui,U2, W, q)p{x3\vi,V3, Ul,U2,W, q) 

xp{yi,y2,y3\xi,x2,x3). (2) 

The lower case letters (q, w,U2,V3 etc.) are realizations of their corresponding random variables. An achievable rate 
region for Cl^JC^^g is described by ^cms{plms)^^cms{Pcms)' defined as the set of all non-negative rate tuples 
R2, R3) such that the inequaUties given in Appendix A hold simultaneously. 

Let Vjyi^g denote the set of all joint probability distributions Ppmsi-)'! t = 1,2 respectively, that factor as follows: 

Plmsil, Wo, Wi,Xi,Uo, U2, X2, Vq, V3, X3, ^1,^2, ^3) = 

p{q)p{wo, wi,xi\q)p{uo\wo, wi,q)p{u2\wo, Wi,q) 
p{x2\uo, U2, Wo, wi,q)p{vo\wo, wi, q)p{v3\wo, wi,q) 

p{x3\vo, V3,wo, wi,q)p{yi,y2, yski, X2, ^3), (3) 

Plmsil^W,Xi,Ui,U2,X2,Vi,V3,X3,yi,y2,y3) = 

p{q)p{w, xi\q)p{ui\w, q)p{u2\w, q)p{x2\ui,U2, w, q) 

p{vi\w, q)p{v3\w, q)p{x3\vi,V3, w, q) 

xp{yi,y2,y3\xi,x2,x3). (4) 

An achievable rate region for Cp^JCp„^g is described by yipms{plms)^^pms{plms)' defined as the set of all non- 
negative rate tuples i?2, -R3) such that the inequalities given in Appendix B hold simultaneously. 

IV. ACHIEVABILITY THEOREM AND PROOF 

Theorem 4.1: Let £*^5(or denote the capacity region of the chaimel C*^5(or C^g); t = 1,2. Let 

^cms = U '^cms{Pcms) ^^^d '^pms ~ U '^pms{Ppms) ■ 

The region ^^^^^(or $n*^J is an achievable rate region for the channel ^^^^(or C*„J, i.e., 9^cms(or ^pms) ^ 



for (£* 
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Proof: We follow the coding scheme presented in [20] to show the achievability of the rate region for the 
three-user channels. The saUent features of this coding scheme are summarized in [20, Remark 1]. We show the 
proof for Cl^^, C^^^, and in that order. 

For the channel : 

A. Codebook generation 

Let us fix G V. Generate a random time sharing codeword q, of length n, according to the distribution 

Y{'i=iP{(li)- For 7 = 0, 1, T = 0, 2 and p = 0, 3: 

generate 2^"^^'^'''^ independent codewords G {1, ...,2r"^ii^l} according to Y\2=iP{wji\qi). For every 

codeword pair (wo(io), Wi(ji)), generate one codeword Xi(jo,ii) according to Yli=i PixulwiiJ) , Qi) . 

generate 2"-(^2^+-'^(^0'^i''^-^l'5)+4e) independent code words Ur(/r), according to YYi=i Piuri\qi). For every codeword 
tuple (uo(/o),U2(/2),WoOo),Wi(ji)), generate one code word ^2{h,h,k,h) according to 

YYi=iP{x2i\uQi{lQ),U2i{l2),woi{jo),wu{h)qi). Uniformly distribute the 2"(-f2-+^(i^O'^i;^-l^3)+4^) code words U^(Z^) 
into 2^^^- bins indexed by kr e {1, ...,2^^^-} such that each bin contains 2"(^(^;^-l'3)+4e) codewords. 

generate 2"(^3p+/(Wo,m,i7o,!72;Vp|Q)+4e) independent code words Vp(tp), according to ]Xi=ip{vpi\q.i). For every code 
word tuple (vo(to), V3(t3), Uo(/o), U2(/2), Wo(jo), Wi(ji)), generate one codeword ^?Xto,hM,h, k, 3i) according 

to a=lP(aJ3i|^^Oi(io),^^3i(i3),^Xoi(«o),^i2i(/2),^«Oi(io),«^li(jl)?i)- Distribute 2«(«3.+/(H/,C/o,C/.;y,|Q)+4.) ^^jjg ^oj.^, 

yp{tp) uniformly into 2"^=*" bins indexed by Vp g{1, ...,2"^=*"} such that each bin contains 2"(^('^'"'^i'^'"^2;^^'IQ)+4e) 
code words. The indices are given by e {1, 2"^i^}, Ir e {i, 2"(^=-+-f(^°'^i'^-l'2)+4^)}, tp e {1,..., 

2n(ii3p+(/(Wo,m ,C/o,C/2 ; Vp |Q)+4e) |_ 

B. Encoding h transmission 

Let us suppose that the source message vector generated at the three senders is (mio, mn, m2o, rn22-, tnzo, m^z) = 
(io,ii, ko,k2, ro,r3). Si transmits codeword xi{jo,ji) with n channel uses. S2 first looks for a codeword Uo(Zo) in 
bin ko such that (uo(/o), Wo(jo), Wi(ji)q) G ^e"\ and a codeword U2(Z2) in bin k2 such that {u2{l2),'Wo{jo), Wi(ji), q) G 
A'f'\ It then transmits X2(/o, ^2, JO) Ji) through n channel uses. Otherwise, ^2 declares an error. 53 first looks for 
a codeword vo(to) in bin tq such that (vo(to)) Uo(Zo)) U2(/2), Wo(io), Wi(ji), q) G Ai^^\ and a codeword V3(t3) in 
bin r3 such that (v3(t3), Uo(/o), "2(^2), Wo(jo), Wi(ji), q) G It then transmits xs{to,ts,lo,l2,jo,ji) through n 
channel uses. Otherwise, S3 declares an error. The transmissions are assumed to be perfectly synchronized. 
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C. Decoding 

The three receivers accumulate an n-length channel output sequence: y^^ at TZi, y2 at 7^2 and y3 at TZ^- Decoder 
1 looks for all index tuples {jo,jiJo,io) such that (wo(jo),wi(ji),uo(/o), vo(io),yi,q) e A'tK If jo and ji in all 
the index tuples found are the same, TZi determines (mio, mn) = {jo,ji) for some lo and to- Otherwise, it declares 
an error. Decoder 2 looks for all index tuples {ioj2,joiio) such that (wo(jo))>io(/o))ii2(/2), vo(to))y2)Q) ^ Ai"'\ 
If lo in all the index pairs found are indices of codewords uo(/o) from the same bin with index ko, and I2 in 
all the index pairs found are indices of codewords U2(^2) from the same bin with index ^2, then TZ2 determines 
(17120,17122) = {ko, k2). Otherwise, it declares an error. Decoder 3 looks for all index pairs (toj^sJoj Jo) such that 
(wo(jo))Uo(^o)) vo(to)) V3(£3),y3,q) G Ai^\ If to in all the index pairs found are indices of codewords vo{io) from 
the same bin with index fo, and is in all the index pairs found are indices of codewords ¥3(^3) from the same bin 
with index r^, then TZ^ determines (m3o,m33) = (fo,r3). Otherwise, it declares an error. 

D. Analysis of probabilities of error 

In this section we derive upperbounds on the probabilities of error events, which happens during encoding and 

decoding processes. We will assume that a source message vector {mio,mii, 11120, 11722, Tn^o, 717^3) is encoded and 
transmitted. We will consider the analysis of probability of encoding error at senders 52 and ^3, and the analysis 
of probability of decoding error at each of the three receivers TZi, 7^2, and TZs separately. 



First, let us define the following events: 

(i) Ej„,j^ ^ {(Wo(jo),Wi(ji),Uo(/o),q) G A^"^}, 

(u) E.^jj^ ^ {(Wo(io),Wi(ji),U2(/2),q) e A^"^}, 

(m) Ej^j^i^i^to = {(WoOo), Wi(ii),Uo(/o),U2(Z2), Vo(to),q) e ^^"^}, 

(iv) Ej,jM,t, 4 {(WoOo),Wi(ji),Uo(Zo),U2(Z2),V3(t3),q) e ^^"^}, 

(v) Ej,j,i^to = {(Wo(io),Wi(ii),Uo(/o),Vo(io),Yi,q) G ^("^j, 

(vi) EjMA = {(Wo(io),Uo(;o),U2(/2),Vo(to),Y2,q) G A^I'^}, 

(vii) EjM,t, = {(Wo(io),Uo(/o),Vo(to),V3(t3),Y3,q) G A^")}. 

= complement of the event E(^ y Events (i) — (iv) will be used in the analysis of probability of encoding error 
while events (v) — (vii) will be used in the analysis of probability of decoding error. 

1) Probability of error at encoder of S2: An error is made if (1) the encoder caimot find Uo(Zo) in bin indexed 
by ko such that (wo(jo)) Wi(ji),uo(Zo))q) G ^e"^ or (2) it caimot find U2(/2) in bin indexed by k2 such that 
(wo(io), wi(ji),U2(/2),q) G ^e""*. The probability of encoding error at S2 can be bounded as 



Pe,S. < P 



n (Wo(io),Wi(ii),Uo(/o),q)^4"^ 
\Uo(io)6bin(fco) J 
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+P n (WoOo), Wi(ii),U2(/2),q) ^ A(A , 

\U2(i2)ebin(fc2) / 

< (i - + i-L - ^[^jojlh)) 

where P(.) is the probability of an event. Since q is predetermined, 

PiEjohio) = E ^(WoOo) = wo, Wi(ji) = wi|q)P(Uo(Zo) = uo|q) 

(wo,Wi,Uo,q)eAi"' 

> 2n{H{Wo,Wi,Uo\Q-e))2-n{H{Wo,Wi\Q+e))2-n{H{Uo\Q+e)) ^ 2-"(^(^'''^i;^«l<3)+3e) 

Similarly, P{Ej^j,i,) > 2-"(^(^'"^i;^^l«)+3^). Therefore, 
Now, 

(1 - 2~"(^(^'''^li'^ol'3)+3e)^2"(^(»'0,»'i;trol'3) + 4-) ^ ^2"(HWo,Wi;UolQ) + ie)Y^(^^_2-^(HWo.Wi:Uo\QH3.)-^ 

^ ^2"<'<"'0''^i'^ol«)+4»)(_2-"(^('^o.Wi;i7olQ)+3«)) 

one 

= e ^ . 

Clearly, Pe,S2 — as n — >^ oo. 

2j Probability of error at encoder of S^: An error is made if (1) the encoder cannot find Vo(to) in bin indexed 
by ro such that (wo(jo)) Wi(ji), Uo(/o); U2(/2), Vo(to); q) G ^e"^ or (2) it cannot find V3(t3) in bin indexed by r?, 
such that (wo(jo),wi(ji),uo(^o), 112(^2), V3(t3),q) G A^l^\ The probabihty of encoding error at ^3 can be bounded 
as 

Pe,s, <P n (Wo(jo),Wi(ji),Uo(/o),U2(l2), Vo(to),q) i 
\Vo(to)ebin(ro) 

/ \ 

+P n (Wo(io),Wi(ii),Uo(/o),U2(Z2),V3(t3),q) ^^''^ 

\V3(t3)ebin(r3) / 

, , ..2'^{I{Wo,Wi,Uo,U2;Vo\Q)+i^) , , 2"<^("'0.«'l>C'0.f2;V3lQ) + 4e) 

< (1 - P{J^jojrlol2to)) + (1 - PiEjojilokts)) 

Since q is predetermined, we have, 

PiP'jojilohto) = 



(wo ,Wi ,Uo ,U2 ,Vo ,q) e A*"' 



E ^(Wo(jo) = wo, Wi(ji) = wi,Uo(Zo) = uo,U2(i2) = U2|q)P(Vo(io) = vo|q) 

> 2n{H{Wo,WuUo,U2,Vo\Q-e))2-n{H{Wo,Wi,Uo,U2\Q)+e)2-n{H{Vo\Q)+e) 

^ 2-niI{Wo,Wi,Uo,U2;Vo\Q)+3t) 
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Similarly, P{Ej^jM,t,) > 2-"(^(^'"^i'^°''^^'^°IO)+3^). Therefore, 



, , r,n(I(Wn,Wi,Un,U2:Vo\Q) + 4c) 

< ("l _ 2-"a(M^o,m,C/o,C/2;Vo|Q)+3e)y _^ 



(^l _ 2~"(-f(^o,VKi,C/o,t/2;V3|Q)+3e) 



2ii(J(W(,,lVi,!7o,C/2;V3lQ) + 4€) 



Proceeding in a way similar to the encoder error analysis at ^2, we get Pe^Ss — > as n ^ oo. 

3) Probability of error at decoder ofTZi: There are two possible events which can be classified as errors: (l)The 
codewords transmitted are not jointly typical i.e., Ej^jj^^^ happens or (2) there exists some jo 7^ jo and ji ^ ji 
such that i?- . ; ; happens. The probability of decoding error can, therefore, be expressed as 

jojiloto 



Kn, - P [Ejonioto U ^j,^j,3.^j,\-jjj (5) 



Applying union of events bound, (182) can be written as. 



p(") < p 



jo^jo,io¥=to jiT^jiJoT^lo ji¥=ji,ia9^to j^^jaji+jikii^^o 

y p(e..,a+ y p(e. .ff)+ y p(E.-.ff)+ y p(e. . f . ) 

< pIe". . , A + 2"^"'P (e~. ■ , A+ 2"^"p (e.-. , ,^ 



,nn{Rio+Rii) p ( ] _i_ 



2n(i?io+i?20+/{Wo,m;C/o|Q)+4e)p ^ 

V jajilota 



, 2"(-fJio+-R30+/(Vl/'o,m,C/o,C/2;Vo|Q)+4e)p _ \ 

V jojilotaj 



+ 



2niRii+R20+I{Wo,Wi;Uo\Q)+4.e) p f ^ ^ ^ 

V jajiloUi 

,')n{Rii+R3o+IiW„,Wi,Uo,U2;Vo\Q)+4e)p{p _ \ , 



2n(/Jio+-Rii+iJ2o+-f(Wo,Vl/i;i7o|Q)+4e)p ^ ^ \ 

.^n{Rio+Rii+R3o+IiWo,Wi,Uo,U2;Vo\Q)+'ie) p { p. . \ _l. 

^ {^jojiloiaj + 

2n{Ru,+R2o+IiWo,Wi-,Uo\Q)+4.€)+R3o+IiW„,Wi,Uo,U2-,Vo\Q)+4e)p - - W 

2n(Rii+R2o+I{Wo,Wi;Uo\Q)+'le)+R3o+IiWo,Wi,Uo,U2-,Vo\Q)+'i^) p ( E - - - W 

V jojiloiaj 

2n{Rio+Rii+R2o+I{Wo,Wi;Uo\Q)+4e)+Rso+I{Wo,WuUo,U2;Vo\Q)+4e)p ( p^ _ ^ 

V jojilo 

Let us now evaluate the probability of error events. 
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can be upper bounded as 

\ jojiloto J 

= ^ P(WoOo) = Wo|q)P(Wi(ji) = Wi,Uo(Zo) = Uq, Vo(to) = vq, Yi = y^lq) 

(wo ,Wi ,Uo ,Vo ,yi ,q)e A^"' 

< 2n(H{Wo,Wi,Uo,Vo,Yi\Q)+e)2-n{H{Wo\Q)-e)2-n(H{WuUo,Vo,Yi\Q)-t) 

^ 2-n{I{Wo;Wi,Uo,Vo,Yi\Q)-3e) 

P (-E'jQjj/oto) can be upper bounded as 

p(e ~ \ 

= ^(Wi(ji) = Wi|q)P(Wo(jo) = wo,Uo(Zo) = uo, Vo(to) = vo,Yi = y^lq) 

(wo , Wi ,Uo , Vo ,y 1 ,q) e A^"^ 

< 2n{H{Wo,W^,Uoyoyl\Q)+<i)2-<H{W^\Q)-t)2-n{H{Wo,Uoyo,Y^\Q)-t) 

^ 2-n{I{W^-^¥o,Uo,Va,YAQ)-^e) _ 

P (-E'jQjj/oto) can be upper bounded as 



P I E"- ' 

\ jojikito 

= ^(Wo(jo) = wo|q)P(Wi(ji) = wi|q)P(Uo(/o) = uq, Vo(to) = vq, Yi = y^lq) 

(wo ,Wi ,Uo ,Vo ,yi ,q) G 

<; 2n{H{Wo,WuUoyo,Yi\Q)+e)2--r^{H{Wo\Q)-e)2-n{H(Wi\Q)^e)2-n{H(Uo,Vo,Yi\Q)-e) 

^ 2-n{IiWo,Wi;Uoyo,Yi\Q)+I{Wo;Wi\Q)-4:e)_ 



can be upper bounded as 



P E. . f. 



= Y ^(Wo(jo) = wo|q)P(Uo(/o) = uo|q)P(Wi(ji) = wi, Vo(io) = vq, Yi = y^lq) 

(wo,Wi,Uo,Vo,yi,q)eAi"' 

< 2n{H{Wo,Wi,Uoyo,Yi\Q)+e)2-n{H{Wo\Q)-e)2-niHiUo\Q)-e)2-n(H{Wiyoyi\Q)-€) 

^ 2-n{I{Wo,Uo;WuVoyi\Q)+I{Wo;Uo\Q)-4:e) 
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P (^Ejgjjj^^ can be upper bounded as 

P ( E- - I 

\ jojiloto J 

= Yl ^(Wo(io) = wo|q)P(Vo(to) = vo|q)P(Wi(ji) = Wi,Uo(Zo) = Uo, Yi = yjq) 

(wo ,wi ,Uo ,Vo ,yi ,q)eAi"^ 

<- 2n{H{Wo,WuUoyoXi\Q)+e)2-^iH{Wo\Q)-e)2-n{H{Vo\Q)-e)2-n{H{Wi,Uo,Yi\Q)-e) 

^ 2-n(I{Wo,Vo;WuUo,Yi\Q)+HWo;Vo\Q)-4:e)_ 

P ij^j^j^i^tt^ can be upper bounded as 

p(e. a 

= Yl ^(Wi(ii) = Wi|q)P(Uo(Zo) = Uolq)P(WoOo) = wq, Vo(to) = vq, Yi = yjq) 

(wo ,Wi ,Uo ,Vo ,yi ,q) e A*"' 

< 2n{H{Wo,WuUoyoXi\Q)+e)2-niH(Wi\Q)-e)2-n{H{Uo\Q)-e)2-n{H{Wo,Vo,Yi\Q)-e) 

^ 2-n{I{Wi,Uo;Wo,Vo,Yi\Q)+HWi;Uo\Q)-4e)_ 

P (-E'jQjj/oto) can be upper bounded as 

p(e ■ '] 

\ jojiloto) 

= YI ^(Wi(ii) = wi|q)P(Vo(to) = vo|q)P(Wo(jo) = Wo,Uo(Zo) = uq, Yi = y^lq) 

(wo ,Wi ,Uo ,Vo ,yi ,q) e aS^"' 

< 2niH{Wo,WuUoyoXi\Q)+e)2-niH{Wi\Q)-e)2-n(HiVo\Q)-e)2-niH{WQ,Uo,Yi\Q)-e) 

^ 2-n{I{Wi,Vo;Wo,Uo,Y^\Q)+I{Wi;Vo\Q)-^e)_ 

can be upper bounded as 

P (e~. . f , 

= Y ^(WoOo) = wolq)P(WiO-i) = wi|q)P(Uo(/o) = uo|q)P(Vo(io) = vq, Yi = y^lq) 

(wo ,wi ,Uo ,vo ,y 1 ,q) e A*"' 

^ 2n{HiWoWi,UoyoXi\Q)+e)2-niH{Wo\Q)-e)2-n(HiWi\Q)-e)2-niH{Uo\Q)-e)2-n{H{Vo,Yi\Q)-e) 

^ 2-n{I{Wo,WuUo;Vo,Yi\Q)+I{Wo,Wi;Uo\Q)+I{Wo;Wi\Q)-5e)_ 
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P (^Ejgj^ij^^ can be upper bounded as 

\ jojiloio J 

= Yl ^(WoOo) = wo|q)P(Wi(ii) = wi|q)P(Vo(to) = vo|q)P(Uo(/o) = uq, Yi = yjq) 

(wo ,wi ,Uo , vo ,yi ,q) 6 A^"' 

< 2n{H{Wo,Wl,UoyoXl\Q)+e)2-niH{Wo\Q)-e)2-n{H{W^\Q)-e)2-n{H{Vo\Q)-e)2-n{H^ 

^ 2-n{I{Wo,Wi,Vo;Uo,Yi\Q)+I{Wo,Wi;Vo\Q)+I{Wo;Wi\Q)-5e) 

P ij^j^j^i^it^ can be upper bounded as 

P (e~. . ff) 

= Yl ^(Wo(jo) = wo|q)P(Uo(Zo) = Uo|q)P(Vo(to) = vo|q)P(Wi(ii) = Wi, Yi = y^lq) 

(wo ,wi ,Uo,Vo ,q) e A^"' 

< 2n{H{Wo,Wi,UoyoXi\Q)+e)2--^iHiWo\Q}-e)2-n{H{Uo\Q)-€)2-n{H(Vo\Q)-€)2-n{H{WuYi\Q)-e) 

^ 2-n(I{Wo,Uo,Vo;Wi,Yi\Q)+I{Wo,Uo;Vo\Q)+I{Wo;Uo\Q)-5e)_ 

can be upper bounded as 

p(e. . ff ) 

= YI ^(Wi(ji) = wi|q)P(Uo(/o) = Uo|q)P(Vo(to) = vo|q)P(WoOo) = Wq, Yi = y^lq) 

(wo ,Wi ,Uo ,Vo ,y J ,q) eA*"' 

^ 2-n(I{W„Uo,Vo;Wo,Yi\Q)+HW„Uo;Vo\Q)+I{W,;Uo\Q)-5e)_ 



(e- i f ) 

\ JoJilotoJ 



can be bounded as 



P I E: -. ; f 



= Y ^(WoOo) = wo|q)P(Wi(ii) = wi|q)P(Uo(/o) = uo|q)P(Vo(to) = vo|q)P(Yi = y^lq) 

(wo,Wi,Uo,Vo,yi,q)GA<"' 

^ 2n{HiWo,WuUoyo,Yi\Q)+e)2-n{H{Wo\Q)-e)2-n{HiWi\Q)-e)2-n{H{Uo\Q)-e)2-niH{Vo\Q)-e)2-niH{^^^ 

^ 2-n{I{Wo,Wl,Uoyo;Y^\Q)+I{Wo,Wl,Uo■yo\Q)+I{Wo,Wl;Uo\Q)+I{Wo,Wl\Q)-6e)_ 
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Substituting these in the probability of decoding error at TZi , we note that P^yl^ ^ as n ^ oo iff the following 
constraints are satisfied: 

Rio<I{Wo;Wi,Uo,Vo,Yi\Q), (6) 
Rii<I{Wr,Wo,Uo,Vo,Yi\Q), (7) 
Rw + Rii<I{Wo,Wv,Uo,Vo,Yi\Q)+I{Wo;Wi), (8) 
^10 + ^20 < I{Wo, Uo; Wi, VoMQ) + I(W^o; Uo\Q) - I{Wo, Wi; C/qIQ), (9) 
Rio + Rm < I{Wo,Vo;WuUo,Yi\Q) + I{Wo-MQ) - I{Wo,WuUq,U2-MQ). (10) 
Rii + R20 < I{Wu Uo; Wo, Vo, Yi\Q) + I{Wv, Uo\Q) - I{Wo, Wr, Uo\Q), (11) 
Rii + R30 < HWuVo; Wo, Uo,Yi\Q) + I{Wr, Vo\Q) - I{Wo, Wi, Uo, U2; Vo\Q), (12) 
Rio + Rii + R20 < I{Wo, Wi, Uo; Vo, Yi\Q) + I{Wo, Wr, Uo\Q) + I{Wo; Wi\Q) - I{Wo, Wr, Uo\Q), (13) 
Rio + Rii + R30 < I{Wo, Wr Vo; Uo, Yi\Q) + I{Wo, Wr Vo\Q) + I{Wo; Wi\Q) - I{Wo, Wr Uo, U2; Vo\Q), (14) 

Rio + R20 + R30 < I{Wo, Uo, Vo; Wi,Yi\Q) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 

-I {Wo, WrUolQ)- I {Wo, WrUo,U2;Vo\Q)il5) 
Ru + ^^20 + R30 < I{Wr Uo, Vo; Wo, Yi\Q) + I{Wr Uo; Vo\Q) + I{Wr Uo\Q) 

-I{Wo, Wr Uo\Q) - I{Wo, Wr Uo, U2; Vo\Q) (16) 
Rio + Ru + R20 + R30 < I{Wo, Wr Uo, Vo; Yi\Q) + I{Wo, Wr Uo; Vo\Q) + I{Wo, Wr Uo\Q) + I{Wo, Wi\Q) (17) 

-I{Wo, Wr Uo\Q) - I{Wo, Wr Uo, U2; Vo\Q) (18) 

4) Probability of error at decoder o/'7^2-' There are two possible events which can be classified as errors: (l)The 
codewords transmitted are not jointly typical i.e., Ej^^i^^^ happens or (2) there exists some lo 7^ Iq and I2 7^ h 
such that . - ; happens. The probability of decoding error can, therefore, be expressed as 



(19) 



Applying union of events bound, (19) can be written as. 



p(e'^ I , + V p(e. f , A + V p(e. , fA + yp (e. + yp(E~.f,, 
+ y p (e-. , r A + y p (e. ; , A + y p (e. , f f) + y p(e. ffA + 



JoiohtQ J Z — ^ \ Johhto J Z — ^ \ Jo 
jo¥'jo,k¥'i2 lo¥'h->,to¥'to ^2^'2><o^to jo¥'jo,io¥'^o,k¥'h 

y p(E'.f,f)+ y p(E'.,ff)+ y p(E.ffA+ y p{E-.^-,f 



jo^jo,l2¥=l-2,to^ta 



Iq^Iq ^127^^2 ^toT^to 



jo ^io,'o7^'o,'2^'2,to^to 
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< p(e'^ , , ) + 2"(^2o+/(Wo,m;C/o|Q)+4e)p/^ _ ) , 
— \ Jolohto J V jolohto' 

jolahto' 

,2n(R2o+R22+I(Wo,Wi;Uo\Q)+4e+IiWo,Wi;U2\Q)+4.t)p(^ _ \, 

^ jolohto' 

jolohio' 

, 2n(il22+fl3o+JW,Wi;C72|Q)+4e+/(Tyo,VFi,{7o,C72;V'o|Q)+4e) p/F , . \ 

,2"^'^R^o+R2o+R22+IiWoWuUo\Q)+At+I(Wo,WuU2\Q)+At)pfp^^ _ \ , 

jolohto) 

2n{Rw+R2o+R3o+I[Wo,W^-,Uo\Q)+U+I{Wo,WuUo,U2-yo\Q)+ie)prp,^ , ^ n 

^ jolohio' 

,2<Rw+R22+R3o+I[Wo^V^■,U2\Q)+ie+I{Wo,WuUo,U2\Vo\Q)+ie)pfp.^ , _ x 

jolohio' 

A_2n{R2o+R22+R3o+I{Wo^V^■,Uo\Q)+'ie+I{Wo^V^■,U2\Q)+ie+I{Wo^V^,Uo,U2■^^^^ _ \ 

jolohio' 

,2<Rw+R2o+R22+R3o+I{Wa,WuUo\Q)+ie+I{Wa^¥^-,U^\Q)+Ae+I{Wo,^^^ _ \ 

^ jolohio' 

Let us now evaluate the probability of error events. 
P{Ejj^^^^^) can be upper bounded as 

"^^^"^^0(0^2*0-^ 

J2 PWo) = uolq)P(WoOo) = Wo,U2(Z2) = U2, Vo(to) = vq, Y2 = y2|q) 

(wo,uo,U2,vo,y2,q)eA^'*^ 

< 2niH(Wo,Uo,U2,Vo,Y2\Q)+e)2-n{H{Uo\Q)-t)2-niH(Wo,U2,Vo,Y2\Q)-e) 

^ 2-n{I{Uo;Wo,U2,Vo,Y2\Q)-3€) _ 

P{E^jj^^J can be upper bounded as 

^^^jolohta"^ 

J2 P{V2{l2) = U2|q)P(WoOo) = wo,Uo(io) = uo, Vo(io) = vo, Y2 = y2|q) 

(wo ,uo ,U2 , vo ,y2 ,q) e A^"^ 

< 2n{H{Wo,Uo,U2,Vo,Y2\Q)+e)2-n{H{U2\Q)-e)2-n{HiWo,Uo,Vo,Y2\Q)-e) 

^ 2-n{I{U2;Wo,Uo,Vo,Y2\Q)-3t) 

P{Ejjj^^J can be upper boxmded as 

^^'^ jolohto^ 

P(Uo(Zo) = uo|q)P(U2(Z2) = U2|q)P(Wo(io) = Wq, Vo(to) = vo,Y2 = y2|q) 

(wo,uo,U2,vo,y2,q)eA^"' 
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< 2n{H{Uo,U2,Wo,Vo,Y2\Q)+e)2-n{H{Uo\Q)-e)2-n{H{U2\Q)-€)2-n{H{Wo,V2,Y2\Q)-€) 

^ 2-n{I{Uo,U2;Wo,Vo,Y2\Q)+HUo;U2\Q)-4e)_ 

P{E^j^^^^J can be upper boxmded as 

J2 nWoOo) = wo|q)P(Uo(Zo) = Uo|q)P(U2(Z2) = U2,Vo(to) = vo,Y2 = y2|q) 

(wo ,Uo ,U2 ,Vo ,y2 ,q) e Al^"' 

< 2"(^(^o.'^o>'^2,yo,y2|Q)+e)2-n(H(VV'o|Q)-e)2-nW;^o|<3)-e)2-"WC^2,Vo,'^'2|Q)-6) 

^ 2-"(-fW.t^o;t^2,Vo,l'2|Q)+/(Wo;!7o|Q)-4e)_ 

P{Ejjj^^J can be upper bounded as 

J2 ^(Wo(io) = wo|q)P(U2(/2) = U2|q)P(Uo(/o) = uo, Vo(to) = vq, Y2 = y2|q) 

(wo ,Uo ,U2 ,Vo ,q) e A*"' 

< 2niH{Wo,Uo,U2,Vo,Y2\Q)+e)2-'^iH{Wo\Q)-e)2-niH{U2\Q)-e)2-n{HiUo,Vo,Y2\Q)-e) 

^ 2-"(^('^0''^2;C/o,yo,'^'2|(3)+/(W'o;[/2|g)-4e) 

P{Ejj^ijJ can be upper bounded as 

J2 ^(Uo(/o) = uo|q)P(Vo(to) = vo|q)P(Wo(jo) = ^0,^2(12) = U2,Y2 = y2|q) 

(wo,Uo,U2,Vo,y2,q)eA^"' 

<- 2n(i?(Wo,C/o,C/2,Vo,y2|Q)+e)2-n(if(C/o|Q)-e)2-n(i?(yo|Q)-e)2-n{-H"(Wo,!72,r2|Q)-e) 

^ 2-"(-f(C^o.^o;^0''^2'^=IQ)+^(t^o;^o|Q)-4e)_ 

P{Ej^^jj^) can be upper bounded as 

^ P(U2(Z2) = U2|q)P(Vo(io) = Vo|q)P(WoOo) = Wo,Uo(Zo)=uo,Y2 = y2|q) 

(wo,uo,U2,vo,y2,q)eA<"' 

< 2"(-'^(^0''^0''^2,yo,y2|Q)+e)2-n(^/(!72|(3)-e)2-"(-'^(^o|Q)-e)2-'i(-ff(l^o,%,>'2|^ 

^ 2-n{I{U2,Vo;Wo,Uo,Y2\Q)+I{U2;Vo\Q)-i€)_ 
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P{E^jj^^^) can be upper bounded as 

^ P(Wo(io) = wo|q)P(Uo(Zo) = uo|q)P(U2(Z2) = U2|q)P(Vo(to) = vq, Y2 = y2|q) 

(Wo,Uo,U2,Vo,y2.q)S^i"' 

< 2n{H{Wo,Uo,U:,yo,Y2\Q)+e}2-niH{Wo\Q)-e)2-n{H{Uo\Q)-e)2-niH{U2\Q)-e)2-n{H{Vo,Y:,\Qy^^ 

^ 2-n{I{Wo,Uo,U2;Vo,Y2\Q)+I{Wo,Uo;U2\Q)+I{Wo;Uo\Q)-5e) 

P{E^j^^j^) can be upper bounded as 

^ P(Wo(jo) = wo|q)P(Uo(Zo) = uo|q)P(Vo(io) = vo|q)P(U2(/2) = U2, Y2 = y2|q) 

(wo ,uo ,U2 ,vo ,y2 ,q) eAi"' 

< 2n{H{Wo,Uo,U2yoX2\Q)+e)2-n{H{Wo\Q)-e)2-n{H{Uo\Q)-€)2-n{H{Vo\Q)-e)2-n{H{U2,Y2\Q)-€) 

^ 2-n{I{Wo,Uo,Vo;U2,Y2\Q)+I{Wo,Uo;Vo\Q)+I{Wo;Uo\Q)-5e)_ 

P{Ej^^jj^) can be upper bounded as 

J2 P(WoOo) = wolq)P(U2(/2) = U2|q)P(Vo(to) = vo|q)P(Uo(/o) = uo, Y2 = y2|q) 

(Wo,Uo,U2,Vo,y2,q)6^e"' 

<- 2n{H{Wo,Uo,U2yo,Y2\Q)+e)2-niH{Wo\Q)-e)2-n{H{U2\Q)-e)2-n{H{Vo\Q)-e)2-n{H{Uo,Y2\Q)-e) 

^ 2-niI{Wo,U2,Vo;Uo,Y2\Q)+I{WQ,U2;Vo\Q)+I{Wo;U2\Q)-5e) 

P{EjjjjJ can be upper bounded as 

^ P(Uo(/o) = uo|q)P(U2(/2) = U2|q)P(Vo(to) = vo|q)P(Wo(io) = Wq, Y2 = y2|q) 

(wo ,uo ,U2 , vo ,y 2 > q) S A 1" ' 

<- 2'n{H{Wo,Uo,U2,Vo,Y2\Q)+e)2-n(H{Uo\Q)-€)2-n{H{U2\Q)-e)2-n(H{VQ\Q)-e)2-n(H(Wo,Y2\Q)-e) 

^ 2-n{I{Uo,U2,Vo;Wo,Y2\Q)+I{Uo,U2;Vo\Q)+I{Uo;U2\Q)-5€) 

P{E^jj^^^) can be upper bounded as 

^ P(Wo(jo) = wo|q)P(Uo(/o) = uo|q)P(U2(/2) = U2|q)P(Vo(to) = vo|q)P(Y2 = y2|q) 

(wo ,Uo ,U2 , Vo ,y2 ,q) e ^e"* 

<; 2n{H{Wo,Uo,U2yo,Y2\Q)+e)2-n{H{Wo\Q)-e)2-n{H{Uo\Q)-e)2-n(HiU2\Q)-c)2-n{H{V„\Q)-c)2-n{^ 

^ 2-n{I{Wo,Uo,U2,Vo-,Y2\Q)+IiWo,Uo,U2;Vo\Q)+I{Wo,Uo-,U2\Q)+I(Wo,Uo\Q)-6e) 
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Substituting these in the probability of decoding error at 7^2 > we note that P^yl^ ^ as n ^ oo iff the following 
constraints are satisfied: 

R20 < I{Uo;Wo,U2,Vo,Y2\Q) - I{Wo,Wi;Uo\Q), (20) 

R22 < I{U2;Wo,Uo,Vo,Y2\Q) - I{Wo,Wi;U2\Q), (21) 

R20 + R22 < liUo, U2; Wo, Vo,Y2\Q) + /(C/o; C/2IQ) - Wv, Uo\Q) - I{Wo, Wi; [/2IQ), (22) 

Rio + R20 < I{Wo, C/o; U2, Vo, Y2\Q) + I{Wo; Uo\Q) - I{Wo, Wi; Uo\Q), (23) 

Rio + R22 < I{Wo, U2; Uo, Vo,Y2\Q) + I{Wo; C/2IQ) - I{Wo, Wi; C/2IQ), (24) 

i?20 + ^30 < HUo, Vo; Wo, U2, 12IQ) + I{Uo; Vo\Q) - I{Wo, Wy, Uo\Q) - /(TVo, Wx,Uo, U2; ^olQ), (25) 

R22 + Rzo < I{U2, Vo; Wo, Uo, I2IQ) + /(C/2; Vo\Q) - I{Wo, Wi; C/2IQ) - I{Wo, Wi,Uo, U2; Vo\Q), (26) 
Rio + R20 + i?22 < /(H^o, Uo, U2; Vo,Y2\Q) + /(VFo, Uo; C/2IQ) + /(T^o; C/olQ) 

-I{Wo, Wr, Uo\Q) - I{Wo, Wi; U2\Q) (27) 
Rio + R20 + R30 < I{Wo, Uo, Vo; U2,Y2\Q) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) - 

I{Wo, Wr, Uo\Q) - I{Wo, Wi, Uo, U2; Vo\Q) (28) 
Rio + R22 + Rio < I{Wo,U2,Vo;Uo,Y2\Q) + I {Wo, U2;Vo\Q) + I {Wo; U2\Q) - 

I{Wo,Wr,U2\Q) - I{Wo,Wi,Uo,U2;Vo\Q) (29) 
R20 + R22 + R30 < I{Uo, U2, Vo; Wo, Y2\Q) + I{Uo, U2; Vo\Q) + I{Uo; C/2IQ) 

-I{Wo, Wi; Uo\Q) - I{Wo, Wr, U2\Q) - I{Wo, Wi, Uo, U2; Vo\Q) (30) 
Rio + R20 + R22 + R30 < I{Wo, Uo, U2, Vo; I2IQ) + I{Wo, Uo, U2; Vo\Q) + I{Wo, Uo; C/2IQ) 

+I{Wo,Uo\Q) - I{Wo,WrUo\Q) - I{Wo,WrU2\Q) - I{Wo,Wi,Uo,U2;Vo\Q) (31) 

5) Probability of error at decoder ofTZ^: There are two possible events which can be classified as errors: (l)The 

codewords transmitted are not jointly typical i.e., Ej^^^^^^^ happens or (2) there exists some to / *o and £3 / 
such that Ei ^ ^ ^ happens. The probability of decoding error can, therefore, be expressed as 

An) 



Kn, - P ( ^hotot, U '^{to^u,h^u)\li^i^ ] (32) 



Applying union of events bound, (32) can be written as. 



P^'i.. < P{El,^,^,^ ]+P{ [Jn^... f.^^.^E, 



+ Y p(E'. , , ,) + Yp(e. f f A + Yp(e. f ^ f) + y p(E'.ffA + 
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^-^ V JolototsJ i-^ \ JolototsJ \ JolototsJ ^-^ V JolototsJ 

<P(E'^ \ I 2'»(^30+/(Wo,m,[/o,[/2;Vo|(3)+4e)p/ e; . \ 

I 9n(ii3o+R33+/(W'o,m,C/o,;72;yo|(3)+4e+/(Wo,Wi,C/o,i72;y3|Q)+4e)p/F . . ^ i 
2n(ilio+«3o+/(Wo,W^i,C/o,C/2;Vo|Q)+4e)pc^. , \ , 
2n(ilio+ii33+J(Wo,VFi,{7o,C72;V'3|Q)+4e) p,' , \ , 

2n(i?io+R2o+K3o+/(Wo,m;%|Q)+4e+/(Wo,m,[/o,C/2;V'o|Q)+4e) p/ _ ^ , 
2n{Rio+R2o+R33+I{Wo,W^;Uo\Q)+4t+I{Wo,WuUo,U2-y3\Q)+Ae)pfp^^ ^ \ , 
2n(flio+ii3o+R33+J(VKo,Wi,C/o,[/2;Vo|Q)+4e+/(M^o,VKi,[7o,C72;V'3|Q)+4e)p/^. - - ) + 
2n(R2o+R3o+R33+/(Wo,m;%|Q)+4e+7{Wo,m,C/o,?72;Vb|Q)+4e+/(Wo,Wi,C/o,i72;V-3|Q ^ - O + 
2n{Rio+R2o+R3o+R33+I{Wo,Wi;Uo\Q)+4€+I{Wo,WuUo,U2;Vo\Q)+4e+I{Wo,WuUo,U2y3\^^ ^ 

Let us now evaluate , ^ + ), -P(-E- , + x ) and ; + x ). 

^ J0t0f0t3'^ ^ JOtOtOC3'^ ^ JOtOtO^S'^ 

P{Ej^ij^^J can be upper bounded as 

-^(-^^0^0*0*3) 

E ^(Vo(io) = vo|q)P(Wo(jo) = wo,Uo(M = «o,V3(t3) = V3,Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)eAi''* 

< 2'*(^W,%,Vo,V3,y3|Q)+e)2-n(^^(^o|Q)-e)2-«WW'o,C/o,V3,'^3|Q)-e) 

^ 2-"U(^o;^o,C/o,V3,y3|Q)-3e)_ 

P{Ej^i^^j_^) can be upper bounded as 

^ P(V3(i3) = V3lq)P(WoOo) = wo, Uo(io) = uo, Vo(to) = vo, Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)eAi"^ 

< 2"(-«"W,C/o,Vo,y3,i1i|Q)+e)2-"(^^(^3|Q)-e)2-"(^(^o,C/o,Vo,>'3|Q)-e) 

^ 2-n{I{V3;Wo,Uo,Vo,Y3\Q)-3e) _ 
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P{Ej^ijj^) can be upper bounded as 

J2 PiMto) = vo|q)P(V3(t3) = V3|q)P(WoOo) = Wo,Uo(Zo) = Uq, Y3 = yglq) 

(wo,Uo,Vo,V3,y3,q)6A<"' 

< 2n{H{Wo,Uo,Vo,V3,Y3\Q)+e)2-n{H{Vo\Q)-e}2-n{HiVs\Q)-e}2-n{H{Wo,Uo,Y3\Q)-e) 

^ 2-n{I{Vo,V3;Wo,Uo,Y3\Q)+HVo;V3\Q)-4e)_ 

Pi^jgigigts) wp^QT boundcd as 

P(Wo(jo) = wo|q)P(Vo(io) = vo|q)P(Uo(/o) = uq, Yalta) = va, Y3 = ya|q) 

(wo,Uo,Vo,V3,y3,q)eA<"' 

< 2niH{Wo,Uo,Vo,V3,Y3\Q)+e)2-n{H{Wo\Q)~e)2-niHiVo\Q)-e)2-niHiUo,V3X3\Q)-€) 

^ 2-n{I{Wo,Vo;Uo,V3,Y3\Q}+I{Wo;Vo\Q)-4e)_ 

Pi^jj^jtois') upper bounded as 



^ P(Wo(jo) = wo|q)P(V3(t3) = V3|q)P(Uo(/o) = uo, Vo(to) = vo,Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)eA^''' 

< 2n{H{Wo,Uoyoy3,Y3\Q)+e)2-n{HiWo\Q)-e)2-n{H{V3\Q)-e)2-n{H{Uo,Vo,Y3\Q)-e) 

^ 2-n{I{Wo,V3;Uo,Vo,Y3\Q)+I(Wo;V3\Q)-4e)_ 

P{Ejjj^^J can be upper bounded as 

^ P(Uo(Zo) = uo|q)P(Vo(io) = vo|q)P(WoOo) = Wq, Va(ta) = va, Y3 = ya|q) 

(wo,Uo,Vo,V3,y3,q)eAi"' 

< 2n{H{Wo,Uo,Vo,V3,Y3\Q)+e)2-n{H{Uo\Q)-e)2-n(H{Vo\Q)-e)2-n{H{Wo,V3,Y3\Q)-e) 

^ 2-n{I{Uo,Vo;Wo,V3,Y3\Q)+I(Uo;Vo\Q)-4e)_ 

P{Ejj^^^fJ can be upper bounded as 

P{E- rt,) 

^ P(Uo(^o) = uo|q)P(V3(ta) = va|q)P(WoOo) = wo,Vo(to) = vq, Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)eA<"' 

< 2"(^(M^o,%,Vb,y3,y3|Q)+e)2-"(^^('^o|Q)-e)2-"(if(Ki|<3)-^)2-«(^(W^o.V'o,y3|Q)-e) 

^ 2-n{I(Uo,V3;Wo,Vo,Y^\Q)+I{Uo;V3\Q)-^^) _ 
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P{E^jj^^J can be upper bounded as 

^ P(Wo(jo) = wo|q)P(Uo(Zo) = Uo|q)P(Vo(io) = vo|q)P(V3(i3) = V3, Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)GAi"' 

< 2n{H{Wo,Uoyoy3,Y3\Q)+e)2-n{H{Wo\Q}-e)2-n{H{Uo\Q)-e)2-n{H{Vo\Q)-e)2-n{H(Vs,Y3\Q)-e^ 

^ 2-n{I{Wo,Uo,Vo;V3,Y3\Q)+HWo,Uo;Vo\Q)+I{Wo;Uo\Q)-5e)_ 

P{E'.j^^^^^) can be upper bounded as 

^ P(Wo(jo) = wo|q)P(Uo(Zo) = uo|q)P(V3(t3) = V3|q)P(Vo(io) = vo, Y3 = y3|q) 

(wo ,Uo ,Vo ,V3 ,q) e aI"' 

< 2n{H{Wo,Uoyay3y3\Q)+e)2-n{H[Wo\Q)-e)2-n{H{Uo\Q)-e)2-n{H{V3\Q)-e^ 

^ 2-n{I{Wo,Uoy3-yo,Y3\Q)+I{Wo,Uo-y3\Q)+I(Wo;Uo\Q)-be)_ 

^^'^joioioU') can be upper bounded as 

J2 ^'(WoOo) = wo|q)P(Vo(to) = vo|q)P(V3(t3) = V3|q)P(Uo(/o) = uo, Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)6A<''' 

<- 2n{H{Wo,Uoyoy3y3\Q)+e)2-n{H{Wo\Q)-e)2-n{Hyo\Q)-e)2-n{H{V3\Q)-e)2-n{H{Uoy3\^^^ 

^ 2-n{i(Woyoy3;Uoy3\Q)+i{Woyoy3\Q)+HWoyo\Q)-5e)_ 

P{EjjjjJ can be upper bounded as 

J2 P{^o{lo) = uo|q)P(Vo(to) = Vo|q)P(V3(t3) = V3|q)P(WoOo) = Wq, Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)eAi"' 

<- 2n{H{Wo,Uoyoy3y3\Q)+e)2-n{H{Uo\Q)-e)2-niH{Vo\Q)-€)2-n(H{V3\Q)-e)2-n(H{Wo,Y3\Q)-e) 

^ 2-n(I{Uoyoy3;Wo,Y3\Q)+I{Uoyoy3\Q)+I{Uoyo\Q)-5e)_ 

P{E^j^f^fJ can be upper bounded as 

^ P(Wo(jo) = wo|q)P(Uo(/o) = uo|q)P(Vo(to) = vo|q)P(V3(t3) = V3|q)P(Y3 = y3|q) 

(wo ,Uo ,Vo ,V3 ,y3 ,q)e^e"' 

< 2n{H{Wo,Uoyoy3y3\Q)+e)2-n{HiWo\Q)-c)2-n{H{Uc^Q)-c)2-niHiVo\Q)-e)2-n{HiV3\Q)-e)^^^ 

^ 2-n{i{Wo,Uoyoy3y3\Q)+i{Wo,Uoyoy3\Q)+i{Wo,Uoyo\Q)+i{Wo;Uo\Q}-6e)_ 
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Substituting these in the probability of decoding error at TZs, we note that P^^^ — >^ as n — >^ oo iff the following 
constraints are satisfied: 

Rso < I{Vo; Wo, Uo, V3, Ys\Q) - I{Wo, Wi, Uo, U2; Vo\Q), (33) 
R33 < I{V3; Wo, Uo, Vo, Ys\Q) - I{Wo, Wi, Uo, U2; F3IQ), (34) 
R30 + R33 < I{Vo, Vs; Wo, Uo, Y3\Q) + I{Vo; VslQ) 
-I{Wo, Wi, Uo, U2; Vo\Q) - I{Wo, Wi, Uo, U2; V^IQ), (35) 
Rio + R30 < I{Wo, Vo; Uo, Vs, YslQ) + I{Wo; Vo\Q) - I{Wo, Wi, Uo, U2; Vo\Q), (36) 
Rio + R33 < I{Wo, V3; Uo, Vo, F3IQ) + I{Wo; F3IQ) - I{Wo, Wi, Uo, U2; l^alQ), (37) 
R20 + R30 < I{Uo, Vo; Wo, V3,Ys\Q) + I{Uo; Vo\Q) - /(Wo, Wv, Uo\Q) - I{Wo, Wi, Uo, U2; Vo\Q), (38) 
R20 + R33 < I{Uo, V3; Wo, Vo, Y3\Q) + I{Uo; FalQ) - I{Wo, Wr, Uo\Q) - I{Wo, Wi, Uo, U2; ^slQ), (39) 
Rio + R20 + R30 < HWo, Uo, Vo; Vs, Y^IQ) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 

-I{Wo, Wi; Uo\Q) - I{Wo, Wi, Uo, U2; Vo\Q), (40) 
Rio + R20 + R33 < I{Wo, Uo, V3; Vo, Ys\Q) + I{Wo, Uo; ValQ) + I{Wo; Uo\Q) 

-/(Wo, Wi; Uo\Q) - /(Wo, Wi, Uo, U2; (41) 
Rio + R30 + R33 < /(Wo, Vo, V3; Uo, Y3\Q) + /(Wo, Vo; VslQ) + /(Wq; Vo\Q) 

-/(Wo, Wi, Uo, U2; Vo\Q) - /(Wo, Wi, Uo, U2; V^IQ), (42) 
R20 + R30 + R33 < I{Uo, Vo, Vs; Wo, YslQ) + I{Uo, Vo; + I{Uo; Vo\Q) 
-/(Wo, Wi; Uo\Q) - /(Wo, Wi, Uo, U2; Vo\Q) - /(Wq, Wi, Uo, U2; Vs\Q), (43) 
Rio + R20 + R30 + R33 < /(Wo, Uo, Vo, V3; Ys\Q) + /(Wo, Uo, Vq; Vs\Q) + /(Wo, Uo; Vo\Q) + /(Wo; Uo\Q) 

-/(Wo, Wi; Uo\Q) - /(Wo, Wi, Uo, U2; Vo\Q) - /(Wq, Wi, Uo, U2; V^IQ). (44) 

The achievable rate region for the channel C^^g follows: 

Rio < /(Wo; Wi, Uo, Vo,Yi\Q), (45) 
Ru < I{Wi;Wo,Uo,Vo,Yi\Q), (46) 
Rio + Ru < /(Wo, Wi; Uo, Vo, Yi|Q) + /(Wq; Wi), (47) 
Rio + R20 < /(Wo, Uo; Wi, Vo, Yi\Q) + /(Wo; Uo\Q) - /(Wo, Wi; Uo\Q), (48) 
Rio + R30 < /(Wo, Vo; Wi, Uo, lilQ) + /(Wo; Vo\Q) - /(Wq, Wi, C/q, C/2; Fo|Q), (49) 
Ru + /?20 < /(Wi, C/o; Wo, Fo, + /(Wi; Uo\Q) - I {Wo, Wi;Uo\Q), (50) 
/?ii + R30 < /(Wi, Vo; Wo, Uo, Yi\Q) + /(Wi; Vb|Q) - /(Wo, Wi, f/o, U2; Vo\Q), (51) 



Rio + Ru + R20 < I{Wo, Wi, Uo; Vq, Yi\Q) + I{Wo, Wv, Uo\Q) + I{Wo; Wi\Q) - I{Wo, Wv, Uo\Q), (52) 
Rio + Ru + R30 < /(Wo, Wi, Vo; Uo, Yi\Q) + I{Wo, Wi; Vo\Q) + I{Wo; Wi\Q) - I{Wo, Wi, Uo, U2; Vo\Q), (53) 

Rio + R20 + R30 < /(Wo, Uo, Vo; Wi,Yi\Q) + I{Wo, Uq; Vo\Q) + I{Wo; Uo\Q) 

-I{Wo, Wi; Uo\Q) - /(Wo, Wi, Uo, U2; Vo\Q) (54) 
Rii + R20 + R30 < /(Wi, Uo, Vo; Wo, Yi\Q) + /(Wi, C/o; Vo\Q) + /(Wi; Uo\Q) 

-/(Wo, Wi; Uo\Q) - /(Wo, Wi, Uo, U2; Vo\Q) (55) 
Rio + iiii + R20 + /?30 < /(Wo, W^i, f/o, Fo; lilQ) + /(Wo, Wi, [/q; T/oIQ) + /(Wo, Wi; [/o|Q) + /(Wq, VFi|Q) (56) 

-/(H^o, Wi; Uo\Q) - /(Wo, Wi, f/o, U2; Vo\Q), (57) 
i?20 < I{Uo; Wo, U2, Vo, Y2\Q) - /(Wo, Wi; C/o|Q), (58) 
R22 < I{U2;Wo,Uo,Vo,Y2\Q) - IiWo,Wi;U2\Q), (59) 
/?20 + R22 < I{Uo, U2; Wo, Vo, I2IQ) + /(C/o; U2\Q) - /(Wo, Wi; f/o|Q) - /(Wo, Wi; C/slQ), (60) 
Rw + R20 < /(Wo, Uo; U2,Vo, Y2\Q) + /(Wq; Uo\Q) - /(Wo, Wi; ?7o|<3), (61) 
Rio + R22 < /(Wo, U2; Uo, Vo, Y2\Q) + /(Wo; U2\Q) - /(Wo, Wi; C/slQ), (62) 
i?2o + R30 < I{Uo, Vo; Wo, U2,Y2\Q) + /(C/o; Vo\Q) - /(Wo, Wi; C/o|Q) - /(Wo, Wi, C/o, C/2; Fo|Q), (63) 
R22 + R30 < /(C/2, Vo; Wo, Uo,Y2\Q) + /(C/2; Vo\Q) - /(Wo, Wi; C/slQ) - /(Wo, Wi, C/o, C/2; Vo\Q), (64) 
i?io + /?2o + R22 < /(Wo, c/o, c/2; ^0, 12IQ) + /(Wo, Uo; U2\Q) + /(Wo; C/o|Q) 

-/(Wo, Wi; C/olQ) - /(Wo, Wi; C/2IQ) (65) 
/?io + R20 + R30 < /(Wo, Uo, Vo; U2,Y2\Q) + /(Wo, Uo; Vo\Q) + /(Wo; C/o|Q) - 

I{Wo, Wi; Uo\Q) - /(Wo, Wi, C/o, C/2; VblQ) (66) 
Rio + R22 + R30 < /(Wo, C/2, Vb; C/o, Y2\Q) + /(Wo, C/2; Fo|Q) + /(Wo; C/2IQ) - 

/(W'o, Wi; C/2IQ) - /(Wo, Wi, Uo, C/2; VblQ) (67) 
i?2o + R22 + i?3o < /(C/o, C/2, Vb; Wo, F2IQ) + /(C/o, C/2; FolQ) + /(C/o; C/2IQ) 

-/(W^o, Wi; C/olQ) - /(Wo, Wi; C/2IQ) - /(Wo, Wi, C/o, C/2; Vb|Q) (68) 
Rio + R20 + R22 + R30 < /(Wo, Uo, C/2, Vo; Y2\Q) + /(Wo, Uo, C/2; Vb|g) + /(Wo, C/o; C/2IQ) 

+/(Wo, C/olQ) - -/(Wo, Wi; C/o|Q) - /(Wo, Wi; C/2IQ) - /(Wo, Wi, C/o, C/2; Fo|Q), (69) 

R30 < I{Vo; Wo, Uo, V3, Ys\Q) - I{Wo, Wi, Uo, C/2; Vo\Q), (70) 
i?33 </(^3;Wo,C/o,Vb,y3|Q) -/(Wo,Wi,C/o,C/2;l^3|g), (71) 
R30 + i?33 < I{Vo, Vs; Wo, Uo, Ys\Q) + /(Vb; V^slQ) 
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-/(Wo, Wi, [/o, U2; Vo\Q) - /(Wo, Wi, i7o, U2; F3IQ), (72) 
i?io + i?30 < /(H^o, Vb; C/o, F3, YslQ) + I^IQ) - I{Wo, Wi, t/o, t/2; FqIQ), (73) 
i2io + i?33 < i"(Wo, F3; c/o, Vb, F3IQ) + /(Wo; F3IQ) - /(W^o, ^i, C^o, C/2; F3IQ), (74) 
i?2o + i?30 < /(C/o, Vb; Wo, F3, 13IQ) + /(C/o; Vb|Q) - /(Wq, Wi; C/o|Q) - /(Wo, Wi, C/o, C/2; Fo|Q), (75) 
/?20 + /?33 < /(C/o, F3; Wo, Vb, IslQ) + /(C/o; FalQ) - /(Wq, Wi; C/o|Q) - /(Wo, Wi, f/o, C/2; V^\Q), (76) 
i?io + -R20 + i?30 < /(VFo, C/o, Vb; F3, >3|Q) + i"(W^o, C/o; Vb|Q) + /(Wq; C/o|g) 

-/(Wo, Wi; f/o|Q) - /(Wq, Wi, ?7o, C/2; Vb|Q), (77) 
Rio + R20 + R33 < I{Wo, C/o, Vs; Vo, Y^\Q) + /(Wq, C/q; FsIQ) + A^o; C/o|Q) 

-/(Wo, Wi; Uo\Q) - /(Wo, Wi, C/o, C/2; F3IQ), (78) 
i^io + R30 + /?33 < /(Wo, Vo, Vs^ f/n, X-ilQ) + /(Wo, Vb; K^IQ) + /(Wo; Vo\Q) 

-/(Wo, Wi, ?7o, C/2; Vo\Q) - /(Wo, Wi, f/o, C/2; ^3!^), (79) 
i22o + R30 + i?33 < /(C/o, Vb, F3; W^o, IslQ) + /(C/o, V^o; V^slQ) + /(C/o; Vb|Q) 
-/(Wo, Wi; C/olQ) - /(Wo, Wi, t/o, C/2; VblQ) - /(Wo, Wi, f/o, C/2; ^3!^), (80) 
Rio + R20 + R30 + R33 < /(Wo, C/o, Vb, ^3; ^3|Q) + /(Wo, C/o, Fo; ^31(3) + /(Wq, C/q; FoIQ) + /(Wq; C/qIQ) 

-/(Wo, Wi; C/olQ) - /(Wo, Wi, C/q, C/2; Vo\Q) - /(Wo, Wi, C/q, U2; VslQ). (81) 

For the channel C^^ns '• 
E. Codebook generation 

Let us fix p(.) G 7^ and let A^J^^ be a typical set. Generate a random time sharing codeword q, of length n, 
according to the distribution nr=iP(90- Generate 2"^ii independent codewords W(j), according to Y\!i=iP{wi\qi). 
For every w(j), generate one Xi(j) codeword according to Y\!i=iP{x\i\wi{j),qi). 

For T = 1,2, generate 2"(^2^+''^(^''^^l*3)+4e) independent codewords lirilr), according to n?=iP('"Tiki)- For 
every codeword triple [ui(Zi),U2(Z2), w(j)], generate one codeword X2(/i,Z2,i) according to 
nr=iP(a;2i|^^ii(^i),n2i(/2),i«i(j),9i)- Uniformly distribute the 2'»(-f^^-+-^(^;^-IQ)+4^) codewords U^(/^) into 2"^^^- 
bins indexed by kr G {1, ...,2"-^^"} such that each bin contains 2'^(^(^'^^l'5)+4<:) codewords. 

For p = 1,3, generate 2"('^3p+i^(W',[/i,c/2;V;|(3)+4e) independent codewords Vp(tp), according to YY^=iP{vpi\qi). 
For every codeword quadruple [vi(ti), V3(t3),ui(Zi),U2(Z2), w(j)],generate one codeword X3(fi,t3,/i,Z2,i) ac- 
cording to nr=iP(^3i|«u(«i),'"3i(t3),?xii(Zi),U2i(Z2),u;i(j),%). Distribute 2"(«3p+/W{7i,C7.;K|Q)+46) codewords 
Vp(tp) uniformly into 2"^=*" bins indexed by rp ...,2"'^!"'} such that each bin contains 2"(^(^'^i''^=;^''l'3)+4e) 
codewords. The indices are given by j G {1, 2"-^"}, Ir G {i, 2"(^^^+^(^;^-l<3)+'^^)} and tp G {1,..., 
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2n{Rs3+I{W,Ui,U2;V,\Q)+ie)y_ 

F. Encoding k, transmission 

Let us suppose that the source message vector generated at the three senders is (mn, m2i, m22, m-si, "^33) = 
{j,ki,k2,ri,rs). The first component is the message index and the last four components are the bin indices. ^2 
looks for a codeword ui(Zi) in bin ki and a codeword U2(/2) in bin k2 such that (ui(Zi), w(j),q) G Ai^^ and 
(ii2(/2), w(j),q) G Ai"'\ respectively. (S3 looks for a codeword vi(ti) in bin ri and a codeword V3(t3) in bin rs 
such that (vi(ti),ui(/i),U2(/2),w(j),q) e ^e"^ and (v3(t3),ui(/i),U2(/2),w(j),q) G ^e"\ respectively. Si, S2 
and 53 then transmit codewords xi(j), X2{h,l2,j) and X3(ti, ^3, ^i, ^2, j), respectively, through n channel uses. The 
transmissions are assumed to be synchronized. 

G. Decoding 

The three receivers accumulate an n-length chaimel output sequence: at TZi, ^2 at Tl2 and y3 at Tl^. Decoders 1, 
2 and 3 look for all indices (j, fi, ti), (^1, ^2) and (ti, 4), respectively, such that (w(j), ui(/i), vi(ti), y^^, q) G A^J^\ 
(ui(fi),U2(f2),y2,q) G ^e"'' and (vi(ti),V3(t3),y3,q) G A^^"'\ If j in all the index triples found are the same, TZi 
declares mn = j, for some li and ti. If in all the index pairs found are indices of codewords ui(/i) from the 
same bin with index k\, and I2 in all the index pairs found are indices of codewords U2(Z2) from the same bin 
with index k2, then Tl2 determines (m2i,m22) = {k\-, ^2)- Similarly, if £1 in all the index pairs found are indices 
of codewords vi(fi) from the same bin with index fi, and £3 in all the index pairs found are indices of codewords 
^3(^3) from the same bin with index f^,, then TZ^, determines (777.31,17133) = {fi,f^). Otherwise, the receivers TZi, 
7^2 and TZ^ declare an error. 

H. Analysis of probabilities of error 

In this section we derive upperbounds on the probabilities of error events, which happens during encoding 
and decoding processes. We will assume that a source message vector (77711,77121,77722,77731,77733) is encoded and 
transmitted. We will consider the analysis of probability of encoding error at senders ^2 and ^3, and the analysis 
of probability of decoding error at each of the three receivers IZi, TZ2, and TZ^ separately. 

First, let us define the following events: 

{i)Eji^^{{W{j),l]i{h),q)eAi''^}, 

(u)^;,,, ^{(W(j),U2(/2),q)G^i"^}, 

(m) Ejij^t, = {(W(j),Ui(/i),U2(;2),Vi(ti),q) G A^")}, 

(iv) Ejij^t, ^ {(W(j),Ui(Zi),U2(/2),V3(i3),q) e ^^"^}, 
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iv) Eji^t^ 4 {(W(i),Ui(/i),Vi(ti),Yi,q) G 4"^}, 
{vi) Eij, ^ {(Ui(/i),U2(Z2),Y2,q) G 4"^}, 
{vii) Et,t, ^ {(Vi(ti),V3(t3),Y3,q) G 4"^}. 

= complement of the event E(^ y Events {i) — {iv) will be used in the analysis of probability of encoding error 
while events {v) — {vii) will be used in the analysis of probability of decoding error. 

1) Probability of error at encoder 0/82: An error is made if {i) the encoder cannot find Ui(Zi) in bin indexed by 
ki such that (w(j), Ui(Zi), q) G or {ii) it cannot find U2(/2) in bin indexed by k2 such that (w(j), U2(Z2), q) € 
Ai"'\ The probability of encoding error at ^2 can be bounded as 
/ \ / 



e,S2 ^ 



< P 



n (W(i),Ui(/i),q) ^ 4") + P n (W(i),U2(Z2),q) ^ 4"^ 

\ui(;i)ebin(fei) / \U2(«2)6bin(fe2) 

< (1 - P(^,,))^""""^""" + (1 - P(^,,2))^""""'"'" 



where P(.) is the probability of an event. Since q is predetermined, 

P{E^l,) = ^ P{W{j) = w\q)P{Vi{h) = ui|q) 

(w,Ui,q)eA<"> 

Similarly, ^(^^j/J > 2-'^(^(^'^=l'3)+3^). Therefore, 

p^^ < (1 - 2-"(-f(^;'^il<3)+3e)')2''f^f"'^'^il«>+*'' + (1 _ 2-'»U(W";!^2|Q)+3e)-)2"(^(«'^^2lQ)+4e) 



Now, 



(1 _ 2~"(-^(^''^il'3)+3e))2"(^(«''^il«'+*«) ^ ^2"(^(W'^ilQ)+*«)ln(l-2-''(^(»^'f'il«)+3«)) 

^ ^2''(-'("'i'^il<3)+''=>(-2-"<-f("'!'^il'3'+3«)) 



Clearly, Pe,52 — >^ as n — 00. 

2j Probability of error at encoder 0/83: An error is made if {i) the encoder cannot find Vi(ti) in bin indexed 

by ri such that (w(j),ui(Zi),U2(Z2), vi(fi),q) G 4"^ or {ii) it cannot find V3(t3) in bin indexed by rs such that 

(w(j),ui(/i),U2(/2), V3(t3),q) G 4"^- The probabiUty of encoding error at S3 can be bounded as 

/ \ 
Pe,s, <P n (W(i),Ui(/i),U2(Z2), Vi(ti),q) ^ 4-) 

\Vi(ti)ebin(r-i) / 

+P fl (W(j),Ui(/i),U202), V3(t3),q) ^ 4"^ 

\v3(t3)ebin(r3) 

< (i - P[Eji^i^tJ) + i-L - ^{Eju^ts)) 
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Since q is predetermined, we have, 

P{EjiM,) = E ^'(W(j) =w,Ui(/i) =Ui,U2(/2) =U2|q)P(Vi(ti) =vi|q) 

(w,Ui,U2,Vi,q)eAi"' 

> 2n(H(W,U„U2yi\Q-e))2-n{H(W,U^,U2\Q)+e)2~n(H{V^\Q)+e) 

^ 2-n{I{W,Ui,U2;Vi\Q)+3e) 

Similarly, P{Ejij^tr) > 2-"(^(^''^i''^^'^3lQ)+3^). Therefore, 

p^^ < ^ _ 2-«UWt^i,'^2;Vi|Q)+3e)y _^ ^ _ 2-"(/WC/i,!72;y3|Q)+3e)y 

Proceeding in a way similar to the encoder error analysis at ^2, we get Pe,S2, ^ as n ^ cxd. 

i) Probability of error at decoder ofTZi: There are two possible events which can be classified as errors: (i)The 
codewords transmitted are not jointly typical i.e., E'^i ^ happens or (ii) there exists some j ^ j such that E'-j ; 
happens. Note that li need not equal li, and ti need not equal ti, since TZi is not required to decode li and ti 
correctly. The probability of decoding error can, therefore, be expressed as 



Applying union of events bound, (82) can be written as, 

Pg.<p(£j.,.)+P(uj^,i5ju) 



2n{Rii+R3i+I{W,UuU2;Vi\Q)+^e)p . j _^ 



2n{i?ii+i?2i+/(H/;C/i|Q)+4e+i?3i+-f(W,l/i,C/2;Vi|Q)+4e)p [ ^ _ 

Let us now evaluate P ( E^., , ) , P ( E.~^ ] ,p(E- ,P (e.-. A. 

P (-f'jijtj) can be upper bounded as 

= E P(W(j) = w|q)P(Ui(/i) =Ui,Vi(ti) = Vi,Yi =yi|q) 

(w,ui,Vi,yi,q)eA*"* 

< 2"(^W'^i''^'i.'*^ilQ)+^)2""(^(^l'3)^")2""(^('^^'^i'^^l'3)"') 

_ 9-n(/(Ty;l/i,yi,yi|Q)-3e) 
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P ( -B.; ^ ) can be upper bounded as 



P \^^Ui) = = w|q)P(Ui(Zi) = ui|q)P(Vi(ti) = vi, Yi = yjq) 

(w,Ui,Vi,yi,q)eAi"' 

P (-^-; I ) '^^'^ upper bounded as 

P i^jiX) = E = w|q)P(Vi(ti) = Vi|q)P(Ui(/i) = Ui, Yi = y,\q) 

(w,Ui,Vi,yi,q)eAi"' 

<■ 2n(/^Wl/i,Vi,yi|Q)+£)2-n(H{iy|Q)-e)2-n(i?(Vi|Q)-e)2-n(//(l/i,yi|Q)-e) 

^ 2-niIiWyi;Ui,Yi\Q)+HW;Vi\Q)-4:e) 



P [ E-j I ) can be upper bounded as 



P [^jijj = E = w)P(Ui(ti) = Ui)P(Vi(/i) = Vi|q)P(Yi = yjq) 

(w,Ui,Vi,yj,q)eA<"' 

< 2"(^^(M^.'^i.^i'"^ilQ)+^)2""(^(^IQ)"^)2""(^(^il'3)"')2""('^(^il'3)"')2""('^(^il'3)^ 

^ 2-"(^(^''^i''^i;^ilQ)+-f(^''^i;^il'3)+^(w^;f^ilQ)-5s) 

Substituting these in the probabiUty of decoding error at TZi, we have, 

pW = g _^ 2"'^"2""('^(^''^i'^i''^il'5)"^^) + 2"(^ii+^2i+-''(^;^il<3)+^^)2~"('^(^''^^'^i''*^^l'3)+^(^''^il'5)"^^) + 

2n(flii+iJ3i+/{l4^,C/i,C/2;Vi|Q)+4e)2-n(/{W^,Vi;i7i,n|g)+-f(VF;yi|Q)-4e) _^ 
2n(iiii+K2i+/(Vy;[/i|Q)+4e+K3i+/(W',i7i,i72;yi|Q)+4e)2-n(7(W',i7i,yi;yi|Q)+/(iy,C/i;yi|^ 

(n) 

^elii ^ as n ^ oo if R21 and iisi satisfy the following constraints: 

Rii < I{W;Ui,Vi,Yi\Q) (83) 
i2ii + i?2i < W?7i;yi,yi|Q) (84) 
Ru + i?3i < I{W, Vi;Ui,Yi\Q) + I{W; Vi\Q) - liW, C/i, C/2; Vi\Q) (85) 
Pii + R21 + iisi < /(VF, Ui,Vr,Yi\Q) + I{W, Ur,Vi\Q)- I{W, Ui,U2;Vi\Q). (86) 

4) Probability of error at decoder of 7^2-' The two possible error events are: (z) The codewords transmitted 
are not jointly typical i.e., E^^i^ happens or (ii) there exists some {li ^ h,l2 / ^2) such that E^j^ happens. The 
probability of decoding error can be written as 



Applying union of events bound, (187) can be written as. 
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< P{Eii) + 2"(^"i+^(^'^il*5)+''') P{Ei ; ) + 2"('^^^+-^(^''^=l'3)+4e)p(£;^ . ) 

_|_2n(R2i+R22+/(W';!7i|Q)+4e+/(Ty;C/2|Q)+4e)p/^, . -v 

Let us now evaluate P{E'^^iJ, PiE^jJ and P{EijJ. 

P{Eij^) can be upper bounded as 

Pi^O = E^(Ui(^i) = ui|q)P(U2(/2) = U2, Y2 = y2|q) 
(ui,u2,y2,q)eAi"^ 

< 2"(^('^i.'^2,>'2|Q)+e)2-"(^^(!^i|Q)-e)2-"('f^(f^2,V'2|Q)-e) 

^ 2-"(-f('^i;'^2,i'2|Q)-3e) 

P{E^j^) can be upper bounded as 

Pi\0 = E^(U2(^2) = U2|q)P(Ui(Zi) = ui, Y2 = y2|q) 

(ui,U2,y2,q)e^i"' 

< 2niH{Ui,U2,Y2\Q)+e)2-n{HiU2\Q)-e)2-n{H{Ui,Y2\Q)-e) 

^ 2-'»U('^2;[/i,y2|Q)-3e)_ 

P{Ej-j^) can be upper bounded as 

Pi^kO = E^(Ui('i) = ui|q)P(U2(Z2) = U2|q)P(Y2 = y2|q) 

(ui,U2,y2,q)GA<"' 

< 2n(H{U^,U2,Y2\Q)+e)2-niHiUi\Q)-t)2-n(H{U2\Q)-e)2-niH(Y2\Q)-e) 

^ 2-'»(^('^i't^2;^2|Q)+i"(t/i;C/2)-4e) 

Substituting these in the probability of decoding error at TZ2, we have, 

=e + 2'»('f^2i+-f(^;'^il'3)+4e)2-"(^(t^i;C^2,Y'2|Q)-3e) _|_ 2n{R22+I{W;U2\Q)+4e)2-n{I{U2;UuY2\Q)-3e) ^ 

2n(R2i+i?22+/(VF;!7i|(3)+4e+/(iy;i72|Q)+4e)2-n(/(C/i,!72;'K2|Q)+/([/i;!/2)-4e) 

(n) 

P^.j^^ ^ as n ^ 00 if P21 and P22 satisfy the following constraints: 

R2i<I{Ui;U2,Y2\Q)-I{W;Ui\Q) (88) 
R22 < I{U2\ UuY2\Q) - I{W- C/2IQ) (89) 
R21 + R22 < I{Ui, U2; Y2\Q) + I{Ur, U2\Q) - I{W- Ui\Q) - I{W- C/2IQ). (90) 
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5) Probability of error at decoder of TZ^: The two possible error events are: (z) The codewords transmitted 
are not jointly typical i.e., Ef^^^ happens or {ii) there exists some (j^i / iij^a / tsj such that Ef:^^ happens. The 
probability of decoding error can be written as 

P^t = P {Kt. U ^(i.^t.tM^ht^ (91) 



Applying union of events bound, (91) can be written as, 

Pejl, < P {Pt.tJ + P {^{t,^t„i3^ts)^ij,) 

< p {Eij + y: PiEf^tJ + E p(PtjJ + E p(Phh 

— \ ^1^3/ ^ tits 

I 2«(«33+/(W^,(7i,(72;V3|Q)+4e)pc_g. , \ I 2"(«3i+/(W,l/i,l/2;Vi|Q)+_R33+/(W^,C/i,C/2;V3|Q)+8e)pc^. , 

V tit-i' ^ tits 

Let us now evaluate P{E^^^J, P{E^jJ and P{E^jJ. 

P{Ej:^^J can be upper bounded as 

P(PhJ = E^(^i(*i) = vi|q)^'(V3(t3) = V3, Y3 = y,\q) 

(vi,v3,y3,q)eA<"' 

^ 2n{H{Vi,Vs,Y3\Q)+e)2-n{H{Vi\Q)~e)2~n{H{V2,Y,\Q)-e) 

^ 2-n{IiVi;V^,Y3\Q)-3^)_ 

P{E^j^) can be upper bounded as 

P(PtjJ = E^(V3(t3) = V3|q)P(Vi(ti) = VI, Y3 = y3|q) 

(vi,v3,y3.q)eA<"' 

< 2n(H{VuV3,Yi\Q)+e)2-niHmQ)-e)2~n{H{VuY3\Q)-e) 

^ 2-n(I{V3;VuY3\Q)-3e) 

P{Ef:jJ can be upper bounded as 

P(PtjJ = E^(Vi(ii) = vi|q)P(V3(t3) = V3|q)P(Y3 = yglq) 

(vi,v3,y3,q)eA<"' 

< 2n(H(Vi,V3,Y3\Q)+e)2~n(H{Vi\Q)-e)2-n(H{V3\Q)-e)2-n{HiY3\Q)-e) 

_ ^-n{I{VuVs;Y3\Q)+I{VuV3)-4.e) 
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Substituting these in the probability of decoding error at TZs, we have, 

p(") _ ^ , nn{R3i+I(W,UuU2;Vi\Q)+ie)r,-n(I{Vi;V3,Ys\Q)-3e) 
2n(i?33+/W!7i,[/2;V'3|Q)+4e)2-n(7(V'3;Vi,y3|Q)-3e) 
2n{Rsi+HW,U„U2;V,\Q)+Rs3+I(W,U„U2;V3\Q)+Se) 
y^2-<Hyiy3\y3\Q)+HVi;V3)-4e) 

(n) 

P^.j^^ ^ as n ^ oo if R31 and i?33 satisfy the following constraints: 

R31 < I{Vi; V3, Ys\Q) - I{W, Ui, U2; Vi\Q), (92) 

R33 < I{V3; Vi,Ys\Q) - I{W, C/i, U2; Vs\Q), (93) 

Rsi + i?33 < I{Vi, V3; Y^IQ) + I{Vr, V3\Q) - I{W, Uu U2; V3\Q) - I{W, U2; Vi\Q). (94) 
The achievable rate region for the channel C^rns given by: 

Rii<I{W;Ui,Vi,Yi\Q), (95) 

Ru + R21 < I{W, Ur, Vi,Yi\Q), (96) 

Rn + ^31 < HW, Vi-Mi,Yi\Q) + I{W; Vi\Q) - I{W, Ui,U2;Vi\Q), (97) 

Ru + R21 + R31 < I{W, Ui, Vi; Yi\Q)I{W, Uv, Vi\Q) - I{W, C/i, C/2; Vi\Q), (98) 

R21 < I{Ui; U2,Y2\Q) - I{W; Ui\Q), (99) 

R22 < I{U2\ Uu Y2\Q) - I{W; U2\Q), (100) 

R21 + R22 < I{Ui, U2; Y2\Q) + I{Ui; C/2IQ) - I{W; Ui\Q) - I{W; U2\Q), (101) 

R31 < I{Vi;V3,Y3\Q) - I{W,Ui,U2;Vi\Q), (102) 

R33 < I{V3;Vi,Y3\Q) - I{W,Ui,U2;V3\Q), (103) 

R31 + R33 < I{Vi, V3; Y3\Q) + I{Vr, F3IQ) - I{W, Ui, U2; F3IQ) - I{W, Ui, U2; Vi\Q). (104) 
For the channel 0^^: 

I. Codebook generation 

Let us fix p(.) G V. Generate a random time sharing codeword q, of length n, according to the distribution 

YYl=iP{qi)- For 7 = 0, 1, r = 0, 2 and /9 = 0, 3: 

generate 2^'^^^-^'^ independent codewords W-y(j^), G {1, 2l^'^^i"'^ } according to 117=1 ^'('"^7^ki)- every 

codeword pair (wo(jo)) wi(ji)), generate one codeword Xi(_7'o, ji) according to 

XYl=iP{xii\wi{j),qi). 
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generate 2"(-'^2T+J(Wo,vi^i;C/T|Q)+4e) independent code words Vrilr), according to Y[7=i PiurilQi)- For every codeword 
tuple (uo(/o),U2(/2),Wo(io),Wi(ji)), generate one code word ^2{h,h, k, 3i) according to 

Y{'l=iP{x2i\uQi{lQ),U2i{l2),woi{jQ),wu{h)qi). Uniformly distribute the 2'^(«^-+^(^"'M/i;C/.|Q)+4e) ^^^^ ^^^^^ u^^^^) 
into T^^^- bins indexed by kr G {1, ...,2"^^-} such that each bin contains 2"(^('^°'^ii^-l'3)+4e) codewords. 

generate 2"(^='p+J(W'o,W"i;Vp|Q)+4e) independent code words \p{tp), according to Y\!i=\p{vpi\qi). For every code 
word tuple (vo(to), ^3(^3), wo(jo), wi(ji)), generate one codeword X3(to, ^3, Jo, Ji) according to 
nr=i p{x^i\voi{tQ),v^i{t^),W(,i{jQ),wii{ji)qi). Distribute2"(«^^-+^(^''"''^i'^''l«)+4^) code words Vp(tp) uniformly into 
2nR3p bins indexed by rp ...,2"^=*"} such that each bin contains 2"(^('^'''^i;^''l'3)+^^) code words. The indices 
are given by G {1, Ir G {1, _^2''iR2.+I{Wo,w^■,u^\Q)+4e)y^ ^ _ _^ 2"(^3.+(/(Wo,m;V-p|Q)+46)|_ 

J. Encoding h transmission 

Let us suppose that the source message vector generated at the three senders is 
(mio, mil, 17120, m22, "iao, '"t-ss) = (jo, Ji, ^o, ro, r^). Si transmits codeword xi(jo, ji) with n channel uses. ^2 
first looks for a codeword Uo(Zo) in bin ko such that (uo(/o), wo(jo), wi(ji), q) G A'f'\ and a codeword U2(Z2) in bin 
k2 such that (u2(Z2), wo(jo), Wi(ji), q) G Ai"'\ It then transmits X2(Zo, hjjo^ji) through n channel uses. Otherwise, 
S2 declares an error, first looks for a codeword vo(to) in bin vq such that (vo(to), Wo(jo), Wi(ji), q) G Ai"'\ and 
a codeword V3(t3) in bin such that (v3(t3), Wo(jo), Wi(ji), q) G Ai"'\ It then transmits X3(to,t3,io, Ji) through 
n channel uses. Otherwise, ^3 declares an error. The transmissions are assumed to be perfectly synchronized. 

K. Decoding 

The three receivers accumulate an n-length channel output sequence: at TZi, ^2 ^2 and at 7^.3. Decoder 
1 looks for all index tuples {jo, ji,io,io) such that (wo(jo),wi(ji),uo(Zo), vo(to),yi,q) G A^"^ If jo and ji in all 
the index tuples found are the same, TZi determines (mio, mn) = (jo, Ji) for some Iq and Iq. Otherwise, it declares 
an error. Decoder 2 looks for all index tuples (4, ^2,io, *o) such that (wo(jo), "0(^0), 02(^2), vo(io),y2,<l) ^ Ai^\ 
If lo in all the index pairs found are indices of codewords uo(Zo) from the same bin with index ^0, and I2 in 
all the index pairs found are indices of codewords U2(/2) from the same bin with index ^2, then TZ2 determines 
(77120,^122) = (^0,^2)- Otherwise, it declares an error. Decoder 3 looks for all index pairs {to, is, ^o, jo) such that 
(wo(jo),uo(/'o), vo(to),V3(t3),y3,q) G Ai^\ If to in all the index pairs found are indices of codewords vo(to) from 
the same bin with index fo, and in all the index pairs found are indices of codewords ¥3(^3) from the same bin 
with index r^, then TZ^ determines (m3o,m33) = (ro,?^3)- Otherwise, it declares an error. 
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L. Analysis of probabilities of error 

In this section we derive upper bounds on the probabiUties of error events, which happens during encoding and 
decoding processes. We will assume that a source message vector (mio,mii,m2o,m22,?Ti30,"i33) is encoded and 
transmitted. We will consider the analysis of probability of encoding error at senders S2 and (S3, and the analysis 
of probability of decoding error at each of the three receivers Tl\, Tl2, and TZs separately. 



First, let us define the following events: 

i) Ej„,j^ ^ {(Wo(jo),Wi(ii),Uo(/o),q) G ^^"^}, 

ii) Ej,j.h = {(WoOo),Wi(ji),U2(/2),q) e ^^"^}, 
in) Ej^j^t, ^ {(WoOo),Wi(ji),Vo(io),q) e A^J"^}, 

iv) Ej,j,ts = {(Wo(jo),WiO-i),V3(t3),q) G A^")}, 

v) EjonUo = {(Wo(jo),Wi(ii),Uo(/o),Vo(to),Yi,q) G A^^^}, 

vi) EjMA = {(Wo(io),Uo(/o),U2(/2),Vo(to),Y2,q) G ^^"^}, 

vii) Ejm = {(Wo(jo),Uo(/o),Vo(io),V3(t3),Y3,q) G ^^"^j. 

= complement of the event E(^ y Events (i) — (iv) will be used in the analysis of probability of encoding error 
while events (v) — (vii) will be used in the analysis of probability of decoding error. 

1) Probability of error at encoder of S2: An error is made if (1) the encoder cannot find Uo(Zo) in bin indexed 
by /co such that (wo(jo), Wi(ji), Uo(/o)) q) G A^J^^ or (2) it cannot find U2(/2) in bin indexed by k2 such that 
(wo(jo))Wi(ji),U2(l2)!q) G A^l^\ The probability of encoding error at ^2 can be bounded as 

Pe,s. <P\ n (Wo(jo),Wi(ji),Uo(/o),q) i 
\Uo(io)6bin(fco) 

/ \ 

+P n (WoOo),Wi(ii),U2(Z2),q)^^^") , 

yu2{«2)Gbin{fe2) / 

where P{.) is the probability of an event. Since q is predetermined, 

P{Eoohio) = E ^(Wo(jo) = Wo, Wi(ji) = Wi|q)P(Uo(Zo) = uo|q) 

{wo,Wi,Uo,q)eAli"' 

> 2niH{Wo,WuUo\Q-e))2-n(H{Wo,Wi\Q+e))2-n{H{Uo\Q+e)) ^ 2-"-(^(^0'^^'^''\^)+^^\ 

Similarly, P{Ej^jj^) > 2-"(^(M^o,Wi;C/2|Q)+3€)_ Therefore, 

p^^ < (1 - 2-"(''"(^'''^i;^''l'3)+3e))2"(^(»'o.»'i;t/ol<3)+4-) + _ 2-nU(W'o,W^i;C/2|Q)+3e)-)2''(^(»'o.'^i;C2lQ)+4.) 
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Now, 



(1 _ 2-"(-''('^o,H'i;!7o|Q)+3e)^2"<^(»'o."'i;'^olQ)+4«) ^ ^2"<-f<»'o.»'i;t'olQ)+4«) ln(l-2-"(-'("'o.»'i;(7olQ)+3e)) 

^ ^2'^{I{W„,Wi;Uo]Q)+4.e)f^__2-'^('(^0''^liVo\Q) + 3^'>) 

-2"' 



Clearly, Pe,S2 ^ as n ^ oo. 

2) Probability of error at encoder of S3: An error is made if (1) the encoder cannot find Vo(to) in bin indexed 
by ro such that (wo(jo), Wi(ji), Vo(to)i Q) £ ^e""* or (2) it cannot find ¥3(^3) in bin indexed by such that 
(wo(io)) Wi(ji), V3(t3), q) G A^e^\ The probability of encoding error at ^3 can be bounded as 

Pe,s, <P n (Wo(jo),Wi(ji),Vo(to),q) i 4"^ 

\Vo(io)ebin(r-o) 

+P fl (Wo(jo),Wi(ji),V3(t3),q) ^^"^ 

\V3(t3)ebin(r3) 

< (i - Fiytjj^j^to}} Pi^jojih)) 
Since q is predetermined, we have, 

HEm) =E^(Wo(jo) = wo, Wi(ii) = wi|q)P(Vo(to) = vo|q) 

y 2n(H{Wo,WuVo\Q-e))2-ri{H(Wo,Wi\Q)+^)2-^iIi(yo\Q)+^) = 2-"(^W,m;Vo|Q)+3e)_ 

Similarly, P{Ej^j^t,) > 2-"(^(^«'^i'^='|Q)+3e)_ Therefore, 

p^^^ < /'i _2-"a(M^o,m;Vo|Q)+3e)\2 ^ _ ^-n{I(Wo,W^■,V^\Q)+3e)Y 

Proceeding in a way similar to the encoder error analysis at 52, we get Pe,S3 —>^ as n oo. 

3) Probability of error at decoder ofTZi: There are two possible events which can be classified as errors: (l)The 
codewords transmitted are not jointly typical i.e., Ej^jj^f.^ happens or (2) there exists some Jq / Jq and ji ^ ji 
such that i?, . ; ; happens. The probability of decoding error can, therefore, be expressed as 

jojiloto 



Applying union of events bound, (182) can be written as. 



jojiloto 



(105) 
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jo¥=jo,io¥=to ji¥=ji,io¥=lo ji¥=ji,io¥=to jo¥'3o,ji¥=ji,lo¥=lo 

y p(E..,f)+ y p(e. .ff)+ y p(e. y p(E-..n) 

Jo^JoJi^ji,to7^to 3o¥^3o,lo¥^lo,to¥^tQ j-L^ji,lo¥^lo,to¥^'to Jo^jo,Ji^Ji,'o^'o,to^to 



jojiloto 



+ 



2n(ilio+i?2o+/(Wo,Wi;;7o|Q)+4€)p . \ 

V jojiloto J 



+ 



, 2n(ilio+R3o+/{Wo,Wi;Vo|Q)+4e)p 

V jojikio^ 

2n(Rii+R2o+I{Wo,Wi;Uo\Q)+4.e) p f ^ _ \ 

V jajikitoj 

_|_2n(ilii+ii3o+i"{Wo,Wi;Vo|Q)+4€)p + 

2n(iiio+ilii+«2o+J(Wo,Wi;[/o|Q)+4e)p , ^ \ 

V jojiloto) 

,r,n(Rio+Rii+R3o+IiWo,Wi;Vo\Q)+4.t) p f p. ^ \ 1 
"•"^ {^jojiloto J 

2n(ilio+il2o+/(Wo,m;C/o|Q)+4e)+ii3o+i"{Wo,Wi;Vo|Q)+4e)p - - + 

V jojiloto J 

2n(Rii+R2o+I(Wo,Wi;Uo\Q)+^e)+R3o+I{Wo,Wi;Vo\Q)+'le) p ( pj . . A a. 

V jojiloto) 

2n(Rio+Rii+R2o+I{Wo,Wi;Uo\Q)+4e)+R3o+I(Wo,Wi;Vo\Q)+4e) p ( _ \ 

V jojiloto) ' 

Let us now evaluate the probability of error events. 
P can be upper bounded as 

\ jojiloto) 

= 5] P(Wo(jo) = wo|q)P(Wi(ii) = wi,Uo(/o) = uo,Vo(to) = vq, Yi = y^lq) 

(wo ,wi ,Uo ,Vo ,yi ,q)e A^"' 

< 2n{H{Wo,Wi,Uo,Vo,Yi\Q)+e)2-'^iH{Wo\Q)-e)2-n{H{Wi,Uo,Vo,Yi\Q)-e) 

^ 2-n{I{Wo;Wi,Uo,Vo,Yi\Q)-^e) _ 

P (^j^jj^tg) can be upper bounded as 



PIE 

V jojiloto 

= ^ P(Wi(ji) = wi|q)P(Wo(jo) = wo,Uo(/o) = uo, Vo(to) = vq, Yi = yjq) 

(wo , Wi ,Uo , Vo ,yi ,q) e^l"* 

<- 2nWWo,Wi,C/o,Vo,Yi|Q)+e)2-n(i?(VKi|Q)-e)2-n(if(Wo,C/o,V'o,Yi|Q)-e) 

^ 2-^-^(1^1 ;W^o,%,Vo,"Ki|g)-3e) 



37 



can be upper bounded as 

\ jojiloto j 

= Yl ^(Wo(io) = wo|q)P(Wi(ii) = wi|q)P(Uo(/o) = Uq, Vo(to) = vq, Yi = yjq) 

(wo ,Wi ,Uo ,Vo ,yi ,q) e A*"' 

< 2n{H{Wo,WuUo,Vo,Yi\Q)+e)2-n{H{Wo\Q)-e)2-n(H{W,\Q)-e)2-n{H(Uo,Vo,Yi\Q)-<^) 

^ 2-n{I{Wo,Wi;Uo,Vo,Yi\Q)+I{Wo;Wi\Q)-4e) 

can be upper bounded as 

P (e-. . f , 



= J2 ^(Wo(jo) = wo|q)P(Uo(/o) = uo|q)P(Wi(ii) = wi, Vo(to) = vq, Yi = y^lq) 

(wo ,wi ,Uo ,Vo ,y 1 ,q) e a'"' 

^ 2niH{Wo,WuUoyoXi\Q)+e)2-n{H{Wo\Q)-e)2-n(H{Uo\Q)-e)2-n{H{Wi,Vo,Yi\Q)-€) 

^ 2-n{I{Wo,Uo;Wi,Vo,Yi\Q)+I{Wo;Uo\Q)-4:e)_ 

P (^Ej^jjj^^ can be upper bounded as 

P ( E- - I 

\ jojiloto J 

= J2 ^(Wo(jo) = wo|q)P(Vo(to) = vo|q)P(Wi(ii) = wi,Uo(/o) = uo, Yi = y^lq) 

(wo ,wi ,Uo ,Vo ,yi ,q) e A^"' 

<- 2n{H{Wo,Wr,UoyoXi\Q)+e)2-^iH{Wo\Q)-e)2-n{H{Vo\Q)-e)2-n{H{Wr,Uo,Yi\Q)-e) 

^ 2-niI(Wo,Vo;Wi,Uo,Yi\Q)+I(Wo;Vo\Q)-4.e)_ 

P (^Ejgjj^jto) ^® upper bounded as 

p(e. 

\ Jojiloto J 

= YI ^(WiO'i) = wi|q)P(Uo(Zo) = uolq)P(WoOo) = wq, Vo(to) = Vq, Yi = yjq) 

(wo ,Wi ,Uo ,Vo ,yi ,q) G Ai"' 

< 2n(H{WQ,Wi,Uo,Vo,Yi\Q)+e)2-n{H{Wi\Q)-e)2-n(H{Uo\Q)-e)2-n{H{Wo,Vo,Yi\Q)-e) 

^ 2-n{I{Wi,Uo;Wo,Vo,Yi\Q)+HWi;Uo\Q)-4e)_ 

P (^jgj^Qtg) can be upper bounded as 



P E ' - 

V jojiloto 

= E ^(Wi(ji) = wi|q)P(Vo(io) = vo|q)P(Wo(jo) = wo,Uo(/o) = uq, Yi = yjq) 

(wo ,Wi ,Uo ,Vo ,yi ,q) e Ai"' 

< 2niH{Wo,Wi,UoyoXi\Q)+e)2-'''iH{Wi\Q)-e)2-n{H(Vo\Q)-e)2-n{H{Wo,Uo,Yi\Q)-e) 

^ 2-n{I{Wi,Vo;Wo,Uo,Yi\Q)+I(Wi;Vo\Q)-4:e) 



38 



P ( E'. . f, ) can be upper bounded as 

p (E'. . fA 

= Pi^oUo) = wo|q)P(Wi(ii) = wi|q)P(Uo(Zo) = uo|q)P(Vo(to) = vq, Yi = y^lq) 

(wo ,wi ,Uo , vo ,yi ,q) e Ai"' 

< 2n(H{Wo,WuUoyo,Yi\Q)+e)2-n(H{Wo\Q)-e)2-n(H(W,\Q)-e)2-n{H{Uo\Q)-e)2-n{H{Vo,Y,\Q)-^^ 

^ 2-n{I{Wo,WuUo;Vo,Yi\Q)+I{Wo,Wi-,Uo\Q)+I{Wo-,Wi\Q)-5e) 

P can be upper bounded as 



P E: . , f 

= ^(Wo(io) = wo|q)P(Wi(ii) = wi|q)P(Vo(io) = vo|q)P(Uo(/o) = uq, Yi = y^lq) 

(wo ,wi ,Uo ,vo ,y 1 ,q) eA*"' 

< 2niH(Wo,Wi,UoyoXi\Q)+e)2-'^iH{Wo\Q)-e)2-n(H{Wi\Q)-e)2-n{H{Vo\Q)-e)2-n{H(Uo,^^^ 

^ 2-n{I{Wo,WuVo;Uo,Yi\Q)+I{Wo,Wi;Vo\Q)+I{Wo;Wi\Q)-5e)_ 

P{E. . f X can be upper bounded as 

p(E'. . f f \ 

= ^(WoOo) = wo|q)P(Uo(/o) = uo|q)P(Vo(io) = vo|q)P(Wi(ji) = wi, Yi = y^lq) 

(wo ,wi ,uo , vo ,yi ,q) e Ai"' 

< 2n{H{WoWuUoyoXAQ)+e)2-n{H{Wo\Q)-e)2-n{H{Ua\Q)-e)2-n{H{Va\Q)-e)2-n{H{^^ 

^ 2-n(I{Wo,Uoyo;WuYi\Q)+I{Wo,Uo-yo\Q)+I{Wo;Uo\Q)-be) 

P (e. '■ f f ] can be upper bounded as 

p(e. ff ) 

= Y ^(Wi(ji) = wi|q)P(Uo(/o) = uo|q)P(Vo(to) = vo|q)P(Wo(io) = wq, Yi = y^lq) 

(wo ,Wi ,Uo , Vo ,y 1 ,q) G A^"' 

< 2n{H(Wo,Wi,UQyoyi\Q)+e)2-n(H(Wi\Q)-e)2-n(H(Uo\Q)-e)2-n{H{Vo\Q)-e)2-n{H{Wo,Yi\Q)-e) 

^ 2-n{I{Wi,Uoyo;Wo,Yi\Q)+I{Wi,Uoyo\Q)+I{Wi;Uo\Q)-5e) 

P ( E'. -■ ) can be bounded as 

V JoJilotoJ 

P ( E-. . f f 

= Y ^(WoU) = wo|q)P(Wi(ji) = wi|q)P(Uo(/o) = uo|q)P(Vo(to) = vo|q)P(Yi = yjq) 

(wo ,wi ,Uo ,Vo ,yi ,q) e^e"' 

2n{H{Wo,Wi,Uoyoyi\Q)+^)2-^>-(H{Wo\Q)-e)2-n{H{Wi\Q)-e)2-n(H{Uo\Q)-c)2-n{Hy^^ 

^ 2-n{I{WoyVuUoyoyl\Q)+I{WoyV^,Uoyo\Q)+I{Wo^V^■,Uo\Q)+I{Wo,W^\Q)-&e) 
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Substituting these in the probability of decoding error at TZi , we note that P^yl^ ^ as n ^ oo iff the following 
constraints are satisfied: 

Rio < I{Wo;Wi,Uo,Vo,Yi\Q), (106) 

Rii<I{Wr,Wo,Uo,Vo,Yi\Q), (107) 

Rw + Ru<IiWo,Wi;Uo,Vo,Yi\Q) + I{Wo;Wi\Q), (108) 

Rio + ^20 < I{Wo, Uo; Wi, Vo,Yi\Q) + I{Wq- Uo\Q) - I{Wo, Wi; C/qIQ), (109) 

Rio + Rso <I{Wo,Vo;Wi,Uo,Yi\Q)+ I{Wo; Vo\Q) - I {Wo, Wr,Vo\Q), (110) 

Ru + R20 < I{Wi, Uo; Wo, Vo, Yi\Q) + I{Wi; Uo\Q) - I{Wo, Wr, Uo\Q), (111) 

Ru + R30 <I{Wi,Vo;Wo,Uo,Yi\Q)+ I{Wr, Vo\Q) - I {Wo, Wr,Vo\Q), (112) 

Rio + Rii + R20 < I{Wo, Wi, Uo; Vo, Yi\Q) + I{Wo, Wr, Uo\Q) + I{Wo; Wi\Q) - I{Wo, Wr, Uo\Q), (113) 

Rio + Rii + R30 < I{Wo, Wr Vo; Uo, Yi\Q) + I{Wo, Wr Vo\Q) + I{Wo; Wi\Q) - I{Wo, Wr Vo\Q), (114) 
Rio + R20 + R30 < I{Wo, Uo, Vo; WrYi\Q) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 

-I{Wo, Wr Uo\Q) - I{Wo, Wr Vo\Q) (115) 
Ru + R20 + ^30 < I{Wr Uo, Vo; Wo, Yi\Q) + I{Wr Uo; Vo\Q) + I{Wr Uo\Q) 

-I{Wo,WrUo\Q) - I{Wo,WrVo\Q) (116) 

Rio + Ru + R20 + ^30 < I{Wo, Wr Uo, Vq; Yi\Q) + I{Wo, Wr Uo; Vo\Q) + I{Wo, Wr Uo\Q) (117) 

+I{Wo, Wi\Q)- I {Wo, WrUolQ)- I {Wo, WrVo\Q) (118) 

4) Probability of error at decoder o/'7^2-' There are two possible events which can be classified as errors: (l)The 

codewords transmitted are not jointly typical i.e., Ej^^i^^^ happens or (2) there exists some Iq ^ /q and I2 7^ h 
such that . - ; happens. The probability of decoding error can, therefore, be expressed as 



(119) 



Applying union of events bound, (187) can be written as. 



p(e'^ I , + V p(e. f , A + V p(e. , fA + yp (e. + yp(E~.f,, 
+ y p (e-. , r A + y p (e. ; , A + y p (e. , f f) + y p(e. ffA + 



JoiohtQ J Z — ^ \ Johhto J Z — ^ \ Jo 
jo¥'jo,k¥'i2 lo¥'h->,to¥'to ^2^'2><o^to jo¥'jo,io¥'^o,k¥'h 

y p(E'.f,f)+ y p(E'.,ff)+ y p(E.ffA+ y p{E-.^-,f 



jo^jo,l2^l2,to^ta 



Iq^Iq ,127^^2 ,to7^to 



jo ^io,'o7^'o,'2^'2,to^to 
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< p(e'^ , , ) + 2"(^=°+'^(^°'^i'^°l*3)+4e)p('£; - ) + 

— \ Jolohto J V jolohto' 

jolahto' 

,2n(R2o+R22+I(Wo,Wi;Uo\Q)+4e+IiWo,Wi;U2\Q)+4.t)p(^ _ \, 

^ jolohto' 

A_2n{R2o+R3o+I{Wo^V^■,Uo\Q)+ie+I{Wo,W^■,Vo\Q)+ie)prp^ . _ ^ 

jolohio' 

,2^{R22+Rso+I{Wa,W^-,U^\Q)+Ae+I(Wo,W^-ya\Q)+Ae)p/p^ , _ n 

jolohto) 

2n(i?io+ii2o+R3o+i'(Wo,Wi;C/o|Q)+4e+7(Wo,W^i;Vo|Q)+4e)p/^, , ^ n 

^ jolohio' 

, 2n(Rio+il22+R3o+/{W-o,Wi;C/2|Q)+4e+7(Wo,m;V'o|Q)+4e)p/E;. , , \ 

jolohio' 

I 2'i(R2o+R22+i?3o+J(Wo,W'i;C/o|Q)+4e+/(W^3,m;!72|(3)+4e+/(»"o,W'i;V'o|(3)+4e)p(-^ _ \ 

jolohio' 

, 2n(iiio+R2o+i?22+ii3o+J(Wo,Wi;C/o|0)+4e+7(Wo,Wi;C/2|Q)+4e+7(Wo,W^i;^^ _ \ 

^ 'jolohio' 

Let us now evaluate the probability of error events. 
P{E.j^^^^^ can be upper bounded as 

"^^'^io'o'2to-^ 

^ P(Uo(/o) = Uolq)P(WoOo) = Wo,U2(Z2) = U2, Vo(to) = vq, Y2 = y2|q) 

(wo,uo,U2,vo,y2,q)eAi"-' 

< 2"(^('^o,t/o,i72,Vo,l'2|Q)+e)2-n(7/(C/o|Q)-e)2-"(^^(W'o,C/2,Vo,y2|(3)-e) 

^ 2-"(''"('^o;^o.'^2'^o,y2|Q)-3e)_ 

P{Ej^^j^^^) can be upper bounded as 

^ P(U2(/2) = U2|q)P(Wo(jo) = wo,Uo(io) = uo,Vo(to) = vo, Y2 = y2|q) 

(Wo,Uo,U2,Vo,y2,q)6^e"'' 

< 2n{H{Wo,Uo,U2,Vo,Y2\Q)+e)2-n{H{U2\Q)-e)2-n{H{Wo,Uo,Vo,Y2\Q)-e) 

^ 2-n{I(U2;Wo,Uo,Vo,Y2\Q)-3t) _ 

P{Ejjj^^^) can be upper bounded as 

^^'^ jolohto^ 

P(Uo(/o) = Uo|q)P(U2(Z2) = U2|q)P(Wo(io) = wo,Vo(to) = vo,Y2 = y2|q) 

(wo ,Uo ,U2 ,Vo ,y2 ,q) e A*"' 

< 2"(-ff('^o,C/2,Wo,yo,y2|Q)+e)2-n(77([/o|(3)-e)2-n(H(C/2|Q)-€)2-n(//(Wo,y2,y2|Q)-€) 
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^ 2-n{I{Uo,U2;Wo,VQ,Y2\Q)+I{Uo;U2\Q)-4e)_ 

P{E^j^^^^^) can be upper bounded as 

P(E-. f , J 

^ P(Wo(jo) = wo|q)P(Uo(^o) = uo|q)P(U2(^2) = U2, Vo(to) = vq, Y2 = y2|q) 

(wo ,Uo ,U2 ,Vo ,q) e A^"' 

< 2'»(-'^(^0''^0''^2,Vo,'K2|Q)+e)2-n(i?(Wo|0)-e)2-n(if(C/o|Q)-e)2-n(i?(Cr2,yo,>'2|Q)-e) 

^ 2-"(^(^o.'^o;'^2,Vo,>'2|Q)+i'(W'o;t/olQ)-4e)_ 

P{E^jj^^^) can be upper bounded as 

^ P(Wo(io) = Wo|q)P(U2(Z2) = U2|q)P(Uo(Zo) = uo,Vo(to) = vo,Y2 = y2|q) 

(wo ,Uo ,U2 ,Vo ,y2 ,q) 6 A*"' 

<• 2"(^^W,!/o,!/2,Vo,>1i|Q)+e)2-"WM^o|Q)-€)2-"(^('^2|Q)-e)2-"WC^o,Vb,'K^ 

^ 2-"(-f(^0't^2;t^o,Vo,l'2|Q)+/(Wo;!72|Q)-4e) 

P{Ejj^^jJ can be upper bounded as 

^ P(Uo(«o) = uo|q)P(Vo(io) = vo|q)P(Wo(jo) = wo,U2(l2) = U2, Y2 = y2|q) 

(Wo ,Uo ,U2 ,Vo ,y2 ,q) e^e"' 

<• 2n{H{Wo,Uo,U2,Vo,Y2\Q)+e)2-'^iH{Uo\Q)-e)2-n{H{Vo\Q)-e)2-n{HiWo,U2,Y2\Q)-e) 

^ 2-'*(-''('^o.^o;l^o.'^2,'K2|Q)+/(C/o;Vo|(5)-4e)_ 

P{Ej^i^jjJ can be upper bounded as 

^ P(U2(Z2) = U2|q)P(Vo(to) = vo|q)P(WoOo) = Wo,Uo(Zo)=Uo,Y2 = y2|q) 

(wo,uo,U2,vo,y2,q)eA<"' 

<- 2»W^o.'^0''^2.'^o,'K2|Q)+e)2-n(//(C/2|Q)-e)2-n(i/(yo|Q)-e)2-"(-'^(^o,C/o,y^ 

^ 2-"(At^2,Vo;Wo,!/o,V2|Q)+/(C/2;Vo|Q)-4e)_ 

P{E^jj^^^) can be upper bounded as 

^ P(Wo(jo) = wo|q)P(Uo(Zo) = uo|q)P(U2(Z2) = U2|q)P(Vo(to) = vq, Y2 = y2|q) 

(wo,uo,u2,vo,y2>q)e^i"' 

<• 2n{H{Wo,Uo,U2yo,Y2\Q)+e)2-niH{Wo\Q)-e)2-n{HiUo\Q)-e)2-n{H{U2\Q)-e)2-n{H{Vo,Y2\Q)-e) 

^ 2-niI{Wo,Uo,U2;Vo,Y2\Q}+I{Wo,Uo;U2\Q)+I{Wo;Uo\Q)-5e) 
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P{E^j^^j^) can be upper bounded as 

^ P(Wo(io) = wo|q)P(Uo(Zo) = uo|q)P(Vo(io) = vo|q)P(U2(Z2) = U2, Y2 = y2|q) 

(Wo,Uo,U2,Vo,y2.q)S^i"' 

< 2n{H{Wo,Uo,U:,yo,Y2\Q)+e}2-niH{Wo\Q)-e)2-n{H{Uo\Q)-e)2-n{H{Vo\Q)-e)2-n{H{U2,Y:,\Q)-^ 

^ 2-n(I{Wo,Uo,Vo;U2,Y2\Q)+I{Wo,Uo;Vo\Q)+I{Wo;Uo\Q)-5e)_ 

P{E^^^jj^) can be upper bounded as 

^ P(Wo(jo) = wo|q)P(U2(Z2) = U2|q)P(Vo(io) = vo|q)P(Uo(/o) = uq, Y2 = y2|q) 

(wo ,Uo ,U2 ,Vo ,q) eAi"' 

< 2n{H{Wo,Uo,U2yoX2\Q)+e)2-n{H{Wo\Q)-e)2-n{H{U2\Q)-€)2-n{H{Vo\Q)-e)2-n{H{Uo,Y2\Q)-€) 

^ 2-"W^')''^2,yo;%,y2|(3)+AW^o,C/2;Vo|Q)+/(Wo;C/2|Q)-5e)_ 

P{Ejjjj^) can be upper bounded as 

J2 P(Uo(/o) = uo|q)P(U2(/2) = U2|q)P(Vo(to) = vo|q)P(Wo(jo) = wo, Y2 = y2|q) 

(Wo,Uo,U2,Vo,y2,q)6^e"' 

<- 2n{H{Wo,Uo,U2yo,Y2\Q)+e)2-niH{Uo\Q)-e)2-n{H{U2\Q)-e)2-n{H{Vo\Q)-e)2-n{H{WoX2\^^ 

^ 2-n{I{Uo,U2,Vo;Wo,Y2\Q)+I{Uo,U2;Vo\Q)+IiUo;U2\Q)-5e) 

P{EjjjjJ can be upper bounded as 

J2 P(Wo(io) = Wo|q)P(Uo(Zo) = uo|q)P(U2(/2) = U2|q)P(Vo(to) = vo|q)P(Y2 = yslq) 

(wq ,Uo ,U2 ,Vo ,y2 ,q)e a!"' 

^ 2n{H{Wo,Uo,U2yo,Y2\Q)+e)2-n{H{Wo\Q}-e)2-n{H{Uo\Q)-€)2-n(H{U2\Q)-e)2-n{H{Vo\Q)-e)2-n{H{Y2\Q)-^ 

^ 2-n{I{Wo,Uo,U2yo;Y2\Q)+I{Wo,Uo,U2;Vo\Q)+I{Wo,Uo-,U2\Q)+I{Wo,Uo\Q)-ee) 

(n) 

Substituting these in the probability of decoding error at Tl2, we note that P^-ji^ — as n — >^ 00 iff the following 
constraints are satisfied: 

P20 < I{Uo;Wo,U2,Vo,Y2\Q) - I{Wo,Wi;Uo\Q), (120) 

P22 < I{U2;Wo,Uo,Vo,Y2\Q) - I{Wo,Wi;U2\Q), (121) 

P20 + P22 < I{Uo, U2; Wo, Vo, F2IQ) + I{Uo; U2\Q) - I{Wo, Wi; Uo\Q) - I{Wo, Wv, U2\Q), (122) 

Pio + P20 < I{Wo, Uo; U2, Vb, F2IQ) + I{Wo; Uo\Q) - I{Wo, Wi; Uo\Q), (123) 
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Rio + R22 < I{Wo,U2; Uo,Vo,Y2\Q) + I{Wo; C/2IQ) - I{Wo,Wr, U2\Q), (124) 

^20 + R30 < I{Uo, Vo; Wo, U2,Y2\Q) + I{Uo; Vo\Q) - I{Wo, Wv, Uo\Q) - I{Wo, Wi; Vo\Q), (125) 

R22 + R30 < HU2, Vo; Wo, Uo, Y2\Q) + I{U2; Vo\Q) - I{Wo, Wv, U2\Q) - I{Wo, Wi; Vo\Q), (126) 
Rio + R20 + R22 < I{Wo, Uo, U2; Vo, Y2\Q) + I{Wo, Uo; C/2IQ) + I{Wo; Uo\Q) 

-IiWo,Wi;Uo\Q) - IiWo,Wi;U2\Q) (127) 
Rio + R20 + R30 < I{Wo, Uo, Vo; U2, Y2\Q) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) - 

I{Wo, Wi;Uo\Q)- I{Wo, Wi; Vo\Q) (128) 
Rio + R22 + R30 < I{Wo, U2, Vo; Uo, I2IQ) + I{Wo, U2; Vo\Q) + I{Wo; C/2IQ) - 

I {Wo, Wr,U2\Q)- I{Wo, Wi; Vo\Q) (129) 
R20 + R22 + R30 < I{Uo, U2, Vo; Wo,Y2\Q) + I{Uo, U2; Vo\Q) + I{Uo; U2\Q) 

-I{Wo, Wi; Uo\Q) - I{Wo, Wi; U2\Q) - I{Wo, Wy, Vb|Q) (130) 
Rio + R20 + R22 + ^^30 < AWo, Uo, U2, Vo; Y2\Q) + li^Wo, Uo, U2; Vo\Q) + 1(1^0, Uo; U2\Q) 

^mo,Uo\Q) - -I{Wo,Wv,Uo\Q) - mo,Wv,U2\Qi) - AWo,Wv,Vo\Q) (131) 

5) Probability of error at decoder ofTZs: There are two possible events which can be classified as errors: (l)The 

codewords transmitted are not jointly typical i.e., Ej^^^^^^ happens or (2) there exists some to / and is / ts 
such that Ei -.^ . happens. The probability of decoding error can, therefore, be expressed as 



pj'ij = p Lb^ , , , I J U.r , , t ^,,E, , . . (132) 



Applying union of events bound, (187) can be written as. 



P^i. < P ( El,,^,^^,^ ]+P{ U,x :^,.E, 



e,H3-^ \^jolatot3j ^ \^^{tof^to,t3f^t3)^jJ^iot3 

+ yp(E-.,,,)+ y"p(E.ff,)+ y"p(E.f,f)+ y p(E'.ff,) + 

jo7^jo,<37^i3 lo^lo^to^to ^O^^OitsT^ts JO T^jo ,'o7^'o 1*0 7^*0 

y p(e.j,A+ y p(E-.,ff)+ y pf^.,--,)+ y pf&. 

io^io,'o7^^o, 47^*3 iof^io.to 7^*0/3^*3 ^o^'o,to^to,4^t3 jo¥=jo,l.o¥=^o,io¥='to,i3¥=t3 

<P(E'^ a I 2"(^30+/(H/o,m,r/o,C/2;Vo|Q)+4£) p/E. . N 

^r,n{R33+I{Wo,WuUo,U2;V3\Q)+Ae)p(T^ . \ 

"^^ ^y^jolotot3> 

,nn{R3„+R33+HWo,Wi-,Vo\Q)+4e+I{Wo,Wi-,V3\Q)+4e)p(p _ ^ i 

"^^ ^y-^jolotot3> ^ 

2n{Rw+R3o+HWo,Wi;Vo\Q)+4e) p( _ ^ , 
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2n(Rio+ii33+J(Wo,m;V3|Q)+4e) PC en, . \ , 

^ jolotots' ^ 

2n{R^o+R3o+I{Wo,WuUo\Q)+Ae+I(Wo,W^-yo\Q)+Ae)pf^ _ x , 

2n{Rio+R2o+R3o+I{Wo,Wi;Uo\Q)+'ie+IiWo,Wi;Vo\Q)+'ie) p( _ \, 
2n{Rlo+R2o+R33+I{Wo^V^■,Uo\Q)+^<^+I(Wa,WuV3\Q)+i^)plp^^ ^ \, 
2n{Rio+R3o+R33+I{Wo,Wi;Vo\Q)+ie+I{Wo,Wi-y3\Q)+ie)p/p^^ - - ) + 
2n{R2o+R3o+R33+I{Wo,Wi;Uo\Q)+4e+I{Wo,Wiyo\Q)+'ie+I{Wo,Wiy3\Q)+'ie)p(^ - - O + 
2n{Rio+Rw+R3o+R33+I{WoWi\Uo\Q)+At+I{Wo,Wiyo\Q)+At+I{Wo,Wiy3\Q)+4^t)p/p^^ _ \ 

Let us now evaluate P{E.^ij^J, P{Ej^i^^j^) and P{E-^^^i^). P{E-j^f^J can be upper bounded as 
^ P(Vo(to) = vo|q)P(Wo(jo) = Wo,Uo(M = >io,V3(t3) = V3,Y3 = y3|q) 

(wo,uo,vo,V3,y3,q)eAl"^ 

< 2"(-«"(^o,C/o,Voy3,y3|Q)+e)2-"(^^(Vo|Q)-e)2-"(^^(l^o,C/o,V3,>3|Q)-e) 

^ 2-"(-f(Vo;Wo,!7o,V3,:i1i|Q)-3e)_ 

P{Ej^i^^j^) can be upper bounded as 

'^(-^joio*ot3) 

E ^(V3(«3) = V3|q)P(Wo(jo) = Wo,Uo(M = >io,Vo(to) = vo,Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)eAi'*^ 

< 2'»(^(W^o,t/oyo,V3,y3|Q)+e)2-n(^^(^3|Q)-e)2-"WW'o,t^o,Vo,>3|Q)-€) 

^ 2-n{I{V3;Wo,Uo,Vo,Y3\Q)-3e) _ 

^(■^joiotots^ can be upper bounded as 

Pi^i lit) 

J2 P(Vo(to) = vo|q)P(V3(i3) = V3|q)P(Wo(jo) = wo,Uo(«o) = uq, Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)eyli"' 

< 2n{H{Wo,Uoyoy3y3\Q)+e)2-n{H{Vo\Q)-e)2-n{H{V3\Q)-e)2-n{H{Wo,Uo,Y3\Q)-e) 

_ r,-n{IiVo,V3;Wo,Uo,Y3\Q)+IiVo;V3\Q)-'ie) 
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P{E^^^j^^J can be upper bounded as 

J2 ^(WoOo) = Wo|q)P(Vo(to) = vo|q)P(Uo(/o) = Uq, V3(t3) = V3, Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)6A<"' 

< 2n{H{Wo,Uo,Vo,V3,Y3\Q)+e)2-n{H(Wo\Q)-e)2-n{H{Vo\Q)-e)2-n{H{Uo,V3,Y3\Q)-e) 

^ 2-n{I{Wo,Vo;Uo,V3,Y3\Q)+I{Wo;Vo\Q)-4e)_ 

Pi^jgigtois) can be upper bounded as 

P(Wo(jo) = wo|q)P(V3(i3) = V3|q)P(Uo(/o) = uq, Vo(to) = vq, Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)eA<"' 

^ 2niH{Wo,Uo,Vo,V3,Y3\Q)+e)2-n{H{Wo\Q)~e)2-niHiV3\Q)-e)2-n(H{Uo,VoX3\Q)-€) 

^ 2-n{I{Wo,V3;Uo,Vo,Y3\Q}+I{Wo;V3\Q)-4e)_ 

P{E.j^^^^^) can be upper bounded as 

^^^3oioiat3^ 

J2 P(Uo(/o) = uo|q)P(Vo(to) = vo|q)P(Wo(jo) = wo, V3(t3) = V3,Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)eA^''' 

< 2n{H{Wo,Uoyoy3,Y3\Q)+e)2-n{H{Uo\Q)-e)2-n(H{Vo\Q)-e)2-n{H{Wo,V3,Y3\Q)-e) 

^ 2-n{I(Uo,Vo;Wo,V3,Y3\Q)+I{Uo;Vo\Q)-4e)_ 

P{Ejj^^^^J can be upper bounded as 

^ P(Uo(Zo) = uo|q)P(V3(i3) = V3|q)P(WoOo) = Wq, Vo(to) = vq, Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)eAi"' 

< 2n{H{Wo,Uo,Vo,V3,Y3\Q)+e)2-n{HiUo\Q)-e)2-n(H{V3\Q)-e)2-n{H{Wo,Vo,Y3\Q)-e) 

^ 2-n{I{Uo,V3;Wo,Vo,Y3\Q)+I(Uo;V3\Q)-4:e)_ 

P{E^j^f^^J can be upper bounded as 

^ P(Wo(jo) = wo|q)P(Uo(Zo) = uo|q)P(Vo(io) = vo|q)P(V3(i3) = V3, Y3 = y3|q) 

(wo ,Uo ,Vo ,V3 ,y3 ,q) e/li"' 

< 2n{H{Wo,Uoyoy3X3\Q)+^)2-n{IiiWo\Q)-e)2-n{H{Uo\Q)~e)2-n{H(Vo\Q)-e)2-n{H(V3X3\Q^ 

^ 2-n{I{Wo,Uo,Vo;V3,Y3\Q)+I{Wo,Uo;Vo\Q)+I{Wo;Uo\Q)-5e)_ 
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P{E^j^^jJ can be upper bounded as 

^ P(Wo(jo) = wo|q)P(Uo(Zo) = Uo|q)P(V3(i3) = V3|q)P(Vo(io) = vq, Y3 = yglq) 

(wo,Uo,Vo,V3,y3,q)GAi"' 

< 2n{H{Wo,Uoyoy3,Y3\Q)+e)2-n{H{Wo\Q}-e)2-n{H{Uo\Q)-e)2-n{H{Vs\Q)-e)2-n{H{Vo,Y3\Q)-e^ 

^ 2-n{I{Wo,Uo,V3;Vo,Y3\Q)+HWo,Uo;V3\Q)+I{Wo;Uo\Q)-5e)_ 

^^'^joioioh^ can be upper bounded as 

^ P(Wo(jo) = wo|q)P(Vo(io) = vo|q)P(V3(i3) = V3|q)P(Uo(/o) = uo, Y3 = y3|q) 

(wo ,Uo ,Vo ,V3 ,q) e aI"' 

< 2n{H{Wo,Uoyoy3X3\Q)+e)2-n{H{Wo\Q)-e)2-n(H{Vo\Q)-e)2-n{H(V3\Q)-e)2-n{H(Uo,Ys\Q)-e) 

^ 2-n{I{Wo,Vo,V3;Uo,Y3\Q)+I{Wo,Vo;V3\Q)+IiWo;Vo\Q)-5e)_ 

P{E.j^^^^^) can be upper bounded as 

J2 ^'(Uo(/o) = uolq)P(Vo(to) = vo|q)P(V3(t3) = V3|q)P(Wo(jo) = wo, Y3 = y3|q) 

(wo,Uo,Vo,V3,y3,q)6Ai"' 

<- 2n(i?{VKo,[/o,Vb,y3,y3|Q)+e)2-n(i?([/o|Q)-6)2-n(if(yo|Q)-e)2-"(^^(^3|Q)-e)2-"(^^(^o,YSi|Q)-e) 

^ 2-niI(Uo,Vo,V3;Wo,Ys\Q)+I{Uo,Vo;V3\Q)+I{Uo;Vo\Q)-5e)_ 

P{EjjjjJ can be upper bounded as 

J2 ^'(WoOo) = wo|q)P(Uo(Zo) = uo|q)P(Vo(to) = vo|q)P(V3(t3) = V3|q)P(Y3 = yglq) 

(wo ,Uo ,Vo ,V3 ,q) e A*"' 

<- 2n{H{Wo,Uoyoy3,Y3\Q)+€)2-n{H{Wo\Q)-e}2-n(H{Uo\Q)-e)2-n{H{Vo\Q)-e)2-n{H{V3\Q)-e)2-n{^ 

^ 2-n(I{Wo,Uoyoy3;Ys\Q)+I(Wo,Uo,Vo-,V3\Q)+HWo,Uo-,Vo\Q)+I(Wo-,Uo\Q)-6e)_ 

(n) 

Substituting these in the probability of decoding error at TZs, we note that P^^^ ^ as n ^ 00 iff the following 
constraints are satisfied: 

R30 < I{Vo; Wo, Uo, V3, Ys\Q) - I{Wo, Wv, ^o|Q),(133) 
R33 < HVs; Wo, Uo, Vo, Y3\Q) - /(Wo, Wv, V3\Q),(m) 
R30 + R33 < I{Vo, V3; Wo, Uo, Y^IQ) + I{Vo; F3IQ) 

-/(Wo, Wi; Vo\Q) - /(Wo, Wi; l^3|Q),(135) 
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Rio + R30 < I{Wo, Vo; Uo, V3, YslQ) + /(Wq; Vo\Q) - I{Wo, Wv, Vb|Q),(136) 
Rio + R33 < I{Wo, F3; Uo, Vo,Ys\Q) + I{Wo; VslQ) - I{Wo, Wv, V3\Q),(13V 
R20 + R30 < I{Uo, Vo; Wo, V3,Ys\Q) + I{Uo; Vo\Q) - I{Wo, Wv, Uo\Q) - I{Wo, Wv, Vb|Q),(138) 
R20 + R33 < I{Uo, V3; Wo, Vo, F3IQ) + I{Uo; VslQ) - I{Wo, Wv Uo\Q) - I{Wo, Wv V3\Q),(139) 
Rio + R20 + R30 < I{Wo, Uo, Vo; V3, Y3\Q) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 

-I{Wo, Wv Uo\Q) - /(Wo, Wv Vb|Q),(140) 
Rio + R20 + R33 < /(Wo, Uo, V3; Vo, Y^IQ) + /(Wo, Uo; V^IQ) + /(Wo; Uo\Q) 

-/(Wo, Wv Uo\Q) - /(Wo, Wv V3\Q),(Ul) 
Rio + R30 + R33 < /(Wo, Vb, ^3; Uo, YslQ) + /(Wo, Fo; Vs\Q) + /(Wo; FolQ) 

-/(Wo, Wi; yo!Q) - /(Wo, Wi; y3|Q),(142) 
R20 + R30 + R33 < I{Uo, Vo, V3; Wo, YslQ) + I{Uo, Vo; VslQ) + I{Uo; Vo\Q) 

-/(Wo, Wv Uo\Q) - /(Wo, Wv Vo\Q) - /(Wo, Wv F3|Q),(143) 
Rio + R20 + R30 + R33 < /(Wo, Uo, Vo, V3; YslQ) + /(Wo, Uo, Vo; ValQ) + /(Wo, Uo; Vo\Q) + /(Wo; Uo\Q) 

-/(Wo, Wv Uo\Q) - /(Wo, Wv Vo\Q) - /(Wo, Wi; y3|Q)(144) 

The achievable rate region follows: 

Rio < /(Wo; Wi,C/o,Vb,yi|Q),(145) 
Ru < I{Wi;Wo,Uo,Vo,Yi\Q),(146) 
Rio + Ru < /(Wo, Wv Uo, Vo, Yi\Q) + /(Wo; Wi|Q),(147) 
Rio + R20 < /(Wo, C/o; Wi, Vb, ^ilQ) + /(Wo; Uo\Q) - /(Wo, Wi; C/o|Q),(148) 
Rio + /?30 < /(Wo, Vo; Wi, C/o, FilQ) + /(Wo; Vb|Q) - /(Wo, Wi; Vb|Q),(149) 
+ i?20 < /(Wi, C/o; Wo, Fo, nlQ) + /(Wi; C/o|Q) - /(Wo, Wv C/o|g),(150) 
/?ii + /?30 < /(Wi, Fo; Wo, c/o, FilQ) + /(Wi; FqIQ) - /(Wo, Wv Fo|Q),(151) 
Rio + Ru + R20 < /(Wo, Wi, Uo; Vo, Yi\Q) + /(Wo, Wv Uo\Q) + /(Wo; Wi|Q) - /(Wo, Wi; C/o|Q),(152) 
i?io + Ru + i?30 < /(Wo, Wi, Fo; C^o, + /(Wo, Wi; Vb|Q) + /(Wo; Wi\Q) - /(Wo, Wi; Vb|Q),(153) 
Rio + R20 + /?30 < /(Wo, C/o, Vb; Wi,yi|Q) + /(Wo, C/o; FolQ) + /(Wo; C/o|Q) 

-/(Wo, Wi; C/olQ) - /(Wo, Wi; yo|QXl54) 
+ R20 + R30 < I{Wi, Uo, Vo; Wo, Yi\Q) + /(Wi, Uo; Vo\Q) + I{Wv Uo\Q) 

-/(Wo, Wi; C/olQ) - /(Wo, Wi; FolQXlSS) 



Rio + Ru + R20 + R30 < HWo, Wi, Uo, Vb; Yi\Q) + I{Wo, Wi, Uq; Vo\Q) + I{Wo, Wi; i7o|QXl56) 

+/(Wo, Wi\Q) - I{Wo, Wi; Uo\Q) - I{Wo, Wr, Vo\Ql\51) 
R20 < I{Uo; Wo, U2, Vo, Y2\Q) - I{Wo, Wr, Uo\Q),im) 
R22 < I{U2; Wo, Uo, Vo, Y2\Q) - I{Wo, Wr, U2\Q),(159) 
R2Q + R22 < I{Uo, U2; Wo, Vo, Y2\Q) + I{Uo; U2\Q) - I{Wo, Wr Uo\Q) - I{Wo, Wr U2\Q),{\m 
Rio + R20 < HWo, Uo; U2, Vo, Y2\Q) + I{Wo; Uo\Q) - I{Wo, Wr C/o|Q),(161) 
Rio + R22 < I{Wo, U2; Uo, Vo, Y2\Q) + I{Wo; UilQ) - I{Wo, Wr U2\Q),(162) 
R20 + R30 < I{Uo, Vo; Wo, U2,Y2\Q) + I{Uo; Vo\Q) - I{Wo, Wr Uo\Q) - I{Wo, Wr Vo\Q),im) 
R22 + R30 < I{U2, Vo; Wo, Uo, F2IQ) + I{U2; Vo\Q) - I{Wo, Wr C/2IQ) - /(Wo, Wr Vo\Q),im) 
Rio + R20 + R22 < I{Wo, Uo, U2; Vo, I2IQ) + nWo, Uo; U2\Q) + /(Wo; Uo\Q) 

-I{Wo, Wr Uo\Q) - /(Wo, Wr f/2|QXl65) 
Rio + R20 + R30 < HWo, Uo, Vo; U2, Y2\Q) + /(Wo, Uo; Vo\Q) + HWo; Uo\Q) - 

HWo, Wr Uo\Q) - /(Wo, Wr Vo\QXl66) 
Rio + R22 + Rso < HWo, U2, Vo; Uo, F2IQ) + /(Wo, U2; Vo\Q) + HWo; C/2IQ) - 

/(Wo, Wi; C/2IQ) - /(Wo, Wi; yo|QXl67) 
R20 + R22 + R30 < HUo, U2, Vo; Wo, Y2\Q) + /(C/o, U2; Vo\Q) + /(f/o; U2\Q) 

-HWo, Wr Uo\Q) - /(Wo, Wr C/2IQ) - /(Wo, Wr Vo\Qim) 

Rio + R20 + R22 + R30 < HWo, Uo, U2, Vo; FalQ) + /(Wq, Uo, U2; Vo\Q) + /(Wq, Uo; U2\Q) 

+HWo, Uo\Q) - -HWo, Wr Uo\Q) - HWo, Wr U2\Q) - /(Wo, Wi; Vo\QXl69) 

R30 < HVo; Wo, Uo, F3, Y^\Q) - HWo, Wr Vb|Q),(i70) 

R33 < /(V^s; Wo, Uo, Vo, Y3\Q) - HWo, Wr V3|g),(171) 
R30 + R33 < HVo, V3; Wo, Uo, Ys\Q) + HVo; VslQ) 

-HWo, Wr Vo\Q) - HWo, Wr F3|Q),(172) 

Rio + R30 < HWo, Vo; Uo, F3, 13IQ) + /(Wo; Vb|Q) - /(Wo, Wr Vo\Q),im) 
Rio + R33 < HWo, V3; Uo, Vo, Y3\Q) + /(Wo; F3IQ) - HWo, Wr F3|Q),(174) 
R20 + R30 < HUo,Vo;Wo,V3,Y3\Q) + HUo;Vo\Q) - HWo,WrUo\Q) - HWo,WrVo\Q),(n5) 
R20 + R33 < HUo, V3; Wo, Vo, YslQ) + HUo; VslQ) - HWo, Wr Uo\Q) - HWo, Wr F3|Q),(176) 
Rio + R20 + R30 < HWo, Uo, Vo; Vs, Y^IQ) + HWo, Uo; Vo\Q) + HWo; Uo\Q) 
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-I{Wo, Wr, Uo\Q) - /(Wo, Wr, Vb|Q),(177) 
Rio + R20 + R33 < I{Wo, Uo, V3; Vo, Y^IQ) + I{Wo, Uo; V3IQ) + I{Wo; Uo\Q) 

-I{Wo, Wi; Uo\Q) - I{Wo, Wi; F3|Q),(178) 
Rio + R30 + R33 < I{Wo, Vo, Vs; Uo, Ys\Q) + I{Wo, Vo; F3IQ) + I{Wo; Vo\Q) 

-I{Wo, Wr, Vo\Q) - I{Wo, Wv, V3\Q),(n9) 
R20 + R30 + R33 < I{Uo, Vo, Vs; Wo, Ys\Q) + I{Uo, Vo; F3IQ) + I{Uo; Vo\Q) 

-I{Wo, Wi; Uo\Q) - I{Wo, Wi; Vo\Q) - I{Wo, Wr, V3\Q),(m) 
Rio + R20 + R30 + R33 < I{Wo, Uo, Vo, V3; FalQ) + I{Wo, Uo, Vo; Vs\Q) + I{Wo, Uo; Vb|Q) + I{Wo; Uo\Q) 

-I{Wo, Wv, Uo\Q) - /(Wo, Wi; Vo\Q) - /(Wo, Wi; y3|Q)(181) 

For the channel C^^: 
M. Codebook generation 

Let us fix p(.) G V. Generate a random time sharing codeword q, of length n, according to the distribution 
nr=i Pili)- Generate 2r"-^"T independent codewords W(j), j € {1, ...,2^^^^^~^ } according to Y[7=i p{wi\qi). For ev- 
ery w(j), generate one Xi(j) codewords according to YYi=i P{^ii\'^i{j)jQi)- For r = 1, 2, generate 2"'('^2r+-f(H';C/x|Q)+4e) 
independent code words Ut-(/i-), according to Yli'=i p{uT-i\qi) . For every code word triple (ui(/i),U2(/2), w(j)), 
generate one code word X2{li,l2,j) according to 112=1 p{x2i\uii{li),U2i{l2),Wi{j),qi). Uniformly distribute the 
2n{R2^+i{W;U^\Q)+4e) ^.^^g ^^j-^g Vr{lr) into 2"^^- bins indexed by kr e {1, 2"^^-} such that each bin contains 
2n(i{W;U^\Q)+4e) codewords. For p = l,3, generate 2"(«3p+/{W;yp|Q)+46) independent code words \pitp), according 
to Yli=iP{vpi\qi). For every code word triple (vi(ti), V3(t3), w(j)), generate one codeword X3(ti,t3,j) according 
to Ui=iPix3i\viiiti),V3i{t3),Wi{j),qi). Distribute 2'*(^3p+/(»';Vp|Q)+4e) ^^^^ ^^j.^^ y^^^^^ uniformly into 2'^^^" 
bins indexed by rp G {1, 2"^=*''} such that each bin contains 2"^*^^(^'^''l'5)+^^) code words. The indices are 
given by j G {1, ...,2"^"}, Ir G {1, ...^2''^^^^+^^^'^^^^^+^% tp G {1, 2"(«3p+(-f(W;Fp|Q)+46)|_ number of 
codewords that we need to generate is obtained during the process of driving the encoder-error to zero. The entire 
codebook is revealed to all senders and receivers. 

N. Encoding &: transmission 

Let us suppose that the source message vector generated at the three senders is 
(mil, m2i, m22, wi3i, m33, ) = (i, ^i, ^2, ^i, '"3)- Si transmits codeword xi(_7) with n channel uses. S2 first looks 
for a codeword Ui(Zi) in bin ki such that (ui(/i), w(j), q) G A^^^ and a codeword U2(^2) in bin k2 such that 
(u2(^2), w(j),q) G Ai"'\ It then transmits X2{li,l2,j) through n channel uses. Otherwise, ^2 declares an error. ^3 
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first looks for a codeword Vi(ti) in bin ri such that (vi(ti), w(j), q) G Ai^\ and a codeword V3(t3) in bin 
such that (v3(t3), w(j), q) G ^46^^^ It then transmits xs{ti,ts, j) through n channel uses. Otherwise, S3 declares an 
error. The transmissions are assumed to be perfectly synchronized. 

O. Decoding 

The three receivers accumulate an n- length channel output sequence: at TZi, ^2 ^2 and at Tlz. Decoder 
1 looks for all index triples {jjijh) such that (w(j),ui(fi),Vi(ti),yi,q) G Ai"'\ If j in all the index triples 
found are the same, TZi determines mn = j, for some h and ti. Otherwise, it declares an error. Decoder 2 looks 
for all index pairs (/i,/2) such that (ui(/i), U2(/2)5 y2) Q) G Ae^\ If li in all the index pairs found are indices of 
codewords Ui(/i) from the same bin with index ^1, and I2 in all the index pairs found are indices of codewords 
112(^2) from the same bin with index k2, then 7^.2 determines (m2i, 777.22) = {ki, k2). Otherwise, it declares an error. 
Decoder 3 looks for all index pairs (iijis) such that (vi(ti), V3(i3),y3,q) € Ai"'\ If ii in all the index pairs found 
are indices of codewords vi(ti) from the same bin with index fi, and in all the index pairs found are indices 
of codewords ¥3(^3) from the same bin with index r^, then TZs determines (77731,77733) = (fi,r3). Otherwise, it 
declares an error. 

P. Analysis of probabilities of error 

In this section we derive upperbounds on the probabilities of error events, which happens during encoding 
and decoding processes. We will assume that a source message vector (77711,77721,7^22,77731,77733) is encoded and 
transmitted. We will consider the analysis of probability of encoding error at senders ^2 and ^3, and the analysis 
of probability of decoding error at each of the three receivers TZi, 7^2, and TZs separately. 

First, let us define the following events: 

(7)i^,,, ^{(W(i),Ui(/i),q)GA(")}, 

(u)£;,,, ^{(W(j),U2(/2),q)G^i"^}, 

(m)i?,i, ^{(W(j),Vi(ti),q)G^(")}, 

{iv)Ejt,^{mj),\s{ts),q)eAi''^}, 

(v) Eji.t, ^ {(W(i),Ui(/i),Vi(ti),Yi,q) G ^("^j, 

(m) Eij^ ^ {(Ui(Zi),U2(Z2),Y2,q) G ^^"^j, 

(vii) Et,u = {(Vi(ti),V3(f3),Y3,q) e A^"^}. 

E^-j = complement of the event i?( ). Events (i) — {iv) will be used in the analysis of probability of encoding error 
while events (v) — (vii) will be used in the analysis of probability of decoding error. 
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1) Probability of error at encoder 0/82: An error is made if (1) the encoder cannot find Ui(Zi) in bin indexed by 



ki such that (w(j), Ui(/i), q) G A^"'^ or (2) it cannot find U2{l2) in bin indexed by k2 such that (w(j), U2(/2), q) € 

\ 

) 

/ 



Ag"^ . The probability of encoding error at ^2 can be bounded as 

\ / 



n (W(i),Ui(/i),q)^4") 
\^Ui(«i)ebin(fei) 



+ P 



n (W(i),U2(Z2),q)^4"^ 

\u2{i2)ebin(fe2) 



m(I(»';C/2lQ)+4e) 



<(1-P(E,J) — (1-P(^,,)) 

where P{.) is the probability of an event. Since q is predetermined, 

PiEjiJ = Yl ^(W(J) = w|q)P(Ui(Zi) = ui|q) 

(w,ui,q)eA<"' 

> 2niH{W,Ui\Q-e))2-niH(W\Q+e))2-n{H{Ui\Q+e)) ^ 2-"('f('^;^il'3)+3^) 

Similarly, P{Eji^) > 2-"(-^(i^;t^=IQ)+3e). Therefore, 

< (1 - 2-"(-^(^;'^il<3)+3e)')2''(J'(«'i'^il«)+*«) + (1 _ 2-"(-f(W';!/2|Q)+3e)-)2"(^(«'i^2lQ)+4e) 



Now, 



< e' 



»i(7(»';(7ilQ) + 4e)^_2-n(-r(W;t/i|Q)+3e)') 



Clearly, Pg ^^ ^ as n ^ 00. 

2) Probability of error at encoder 0/83: An error is made if (1) the encoder cannot find Vi(fi) in bin indexed by 

ri such that (w(j), vi(ti), q) G A'f'^ or (2) it cannot find V3{ts) in bin indexed by such that (w(j), V3(i3),q) G 

Ae"^ . The probability of encoding error at S3 can be bounded as 
/ 

Pe,Ss < P 

<{l-P{E,tjf 



ility of encoding error at S3 can be bounded as 

n (W(j), Vi(fi),q) ^ 4") + P n (W(j), V3(t3),q) ^ 4"^ 

i'i(ti)ebin(ri) / \V3(t3)ebin(r3) / 

. . 9"(^(W;Vi|Q)+4e) , , ^ ^ 9n(J(W;V3|Q)+4e) 

< n - PI'S.. \Y + (1 - P{Ejts)) 



Since q is predetermined, we have, 

P{EjtJ = ^P(W(j) = w|q)P(Vi(ii) = vi|q 



> 2 



(w,Vi,q)eA^"^ 
,n(i?(W,yi|Q-e))2-n(if(W|Q)+e)2-n(i?(Vi|Q)+e) 



^ 2-niI{W;Vi\Q)+3e) 



Similarly, P{Ejt,) > 2-"(-f(^;^3|Q)+36)_ Therefore, 

+ A _ 2-nU(W';^^3|Q)+3e)y 



P^^^ < (1 - 2-"W^;^ii'2)+36)y 

Proceeding in a way similar to the encoder error analysis at S2, we get Pe,S3 as n ^ 00. 
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3) Probability of error at decoder ofTZi: There are two possible events which can be classified as errors: (l)The 
codewords transmitted are not jointly typical i.e., Ej^^^^ happens and/or (2) there exists some j ^ j such that ; 
happens. Note that li need not equal li, and ii need not equal ti, since TZi is not required to decode li and ii 
correctly. The probability of decoding error can, therefore, be expressed as 



Applying union of events bound, (182) can be written as. 



2n(Rii+iJ3i+/(Vl/;Vi|Q)+4e)p \ , 2"(«ii+'R2i+/(VK;C/i|Q)+4£+iJ3i+/(H/;yi|Q)+4e)p _ 



Let us now evaluate P ( E~., , ) , P ( E.~- ] , P (e^-.) , P ( E.-. A. 

P ^Sj.^^^^^ can be upper bounded as 

P (^iwj = E ^(W(J) = w|q)P(Ui(/i) = ui, Vi(ti) = VI, Yi = yi|q) 

(w,Ui,Vi,yi,q)eA*"' 

< 2"(^W'^i''^'i.'*^ilQ)+^)2-"(^(^l'3)"")2""(^('^i''^i'^il'3)-<:) 

^ 2-n{I{W;UuV,,Y,\Q)-3e) ^ 

P (^E~j ^ ^ can be upper bounded as 

jllti 



P ( ) = E = w|q)P(Ui(Zi) = Ui|q)P(Vi(fi) = Vi, Yi = yjq) 

(w,Ui,Vi,yj,q)eAl"' 

< 2n{H{W,Utyiyt\Q)+e)2-n{H{W\Q)-e)2~n{H(Ut\Q)-e)2-n{H{Vtyi\Q)-e) 



P ^P..^ I ^ can be upper bounded as 

P {E]iJ,) = E ^(W(i) = w|q)P(Vi(ti) = Vi|q)P(Ui(/i) = Ui, Yi = y^lq) 

(w,ui,Vi,yi,q)eAi"' 

< 2n{H{W,Ui,Vi,Yi\Q)+^)2~"-iH{W\Q)-e)2-n(H{Vi\Q)-e)2-n{H{Ui,Yi\Q)-e) 
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P ( -B-j I ) can be upper bounded as 



P [E^UJ = ^ ^^^^^^ = w)P(Ui(ti) = ui)P(Vi(/i) = vi|q)P(Yi = yi|q) 

(w,Ui,Vi,yi,q)eA<"' 

^ 2n{H{W,U^y^,Y^\Q)+e)2-n{H{W\Q)^e)2-n{H{U^\Q)~e)2~■n{H{V^\Q)^t)2-n(H{Y^\Q)-e) 



2 



-n(7(W,l/i,yi;yi|Q)+/(VK,(7i;Vi|Q)+/(H/;C/i|Q)-5e) 



Substituting these in the probabiUty of decoding error at TZi, we have, 

2n(flii+i?3i+/(W/;Vi|Q)+4e)2-n(/{l4^,Vi;t/i,n|Q)+/(Vy;Vi|Q)-4e) _|_ 
2n(i?,ii+R2i+/(VF;i7i|Q)+4e+R3i+/(VF;yi|(3)+4e)2-n(/(W',l/i,yi;yi|Q)+/(W,C/i;yi|Q)+/(H^;6ri|Q)-5e) 

Peiii ^ as n — > cxD if Ru, R21 and R-^i satisfy the following constraints: 

Rii<I{W-Ui,Vi,Yi\Q) (183) 

Rii + R2i<I{W,Ui;Vi,Yi\Q) (184) 

Rii + Rzi<I{W,Vi-Ui,Yi\Q) (185) 

+ R21 + R31 < I{W, UuVi;Yi\Q) + I{W, Ui;Vi\Q) - I{W; Vi\Q). (186) 

4) Probability of error at decoder ofTZ2' The two possible error events are: (1) The codewords transmitted are 
not jointly typical i.e., Ef^^^ happens and/or (2) there exists some {li / h^h / ^2) such that Ej^j^ happens. The 
probability of decoding error can be written as 



Applying union of events bound, (187) can be written as. 



Pe%. - P {Plih) + P [^{h^hh^h)Phi) 

= p (EU + E p(PlO + E P(PijJ + E P(PhO 

< P{Efi) + 2"(^2i+/(Vy;f/i|Q)+4e)p^^_ ^ ^ _^ 2"(^22+/(W';C/2|Q)+4e)p^_g.^ . ^ 

_^2"(^2i+iJ22+/{W^;C/i|Q)+4e+/(W';(72|Q)+4e)p/-p. , \ 

Let us now evaluate P{Ei^^J, PiE^jJ and P{EyJ. 
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P{E^^^J can be upper bounded as 

P(^iJ = E^(Ui(^i) = ui|q)P(U2(/2) = U2, Y2 = y2|q) 

(ui,u2,y2,q)eA<"' 

< 2n{H{Ui,U2,Y2\Q)+e)2-n{H{Ui\Q)~e)2-n{H{U2,Y2\Q)-e) 

^ 2-n(I{UuU2,Y2\Q)-3e) ^ 

P{EijJ can be upper bounded as 

P(\0 = E^(U2a2) = U2|q)P(Ui(/i) = ui, Y2 = y2|q) 

(ui,u2,y2.q)eA<"' 

2MH{Ui,U2,Y2\Q)+e)2~ri{H{U2\Q)-e)2-n{H{Ui,Y2\Q)-e) 

^ 2-n{I{U2;UuY2\Q)-3e) 

P{E^jJ can be upper bounded as 

^(^/V;) = E^(Ui('i) = ui|q)P(U2(/2) = U2|q)P(Y2 = yslq) 

{ui,u2,y2,q)evi<"' 

< 2n(H{Ui,U2,Y2\Q)+e)2-n{H{Ui\Q)~e)2-n{H{U2\Q)-e)2~n{H{Y2\Q)~e) 

^ 2-n{I{UuU2;Y2\Q)+I(UuU2)-4e) _ 

Substituting these in the probabiUty of decoding error at 7^2> we have, 

^ g _^ 2"(^2i+-f(M/;!7i|Q)+4e)2-n{/(C/i;t/2,y2|Q)-3e) _^ 2"('f^22+^(^;^2|<3)+'^^)2~"(^(^"'^i''^'l'3)"^') + 

2n(R2i+i?22+-f(H^;C/i|Q)+4e+/(W;(72|Q)+4e)2-n(/(t/i,C/2;Y2|Q)+/(!7i;(72)-4e) 

(n) 

P^ll^ ^ as n — > oo if i?2i and R22 satisfy the following constraints: 

R21 < I{Ui;U2,Y2\Q) - I{W;Ui\Q) (188) 
R22 < IiU2;Ui,Y2\Q) - I{W;U2\Q) (189) 
R21 + P22 < /(f/i, U2; I2IQ) + /(C/i; f/2|Q) - I{W; Ui\Q)- I{W; C/2IQ). (190) 

5) Probability of error at decoder ofTZ^: The two possible error events are: (1) The codewords transmitted are 
not jointly typical i.e., -Etita happens and/or (2) there exists some (ti ^ti,i^^ such that E^^j.^ happens. The 
probability of decoding error can be written as 

pi% = p {Kt. U U(.v*,,v*3)^M'3) (191) 



Applying union of events bound, (191) can be written as. 
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Pit ^ P + P (U(tV*.,*Vt3)^t.f3) 

< p (EU) + E Pi^t.J + E Pi^td.) + E PiE{,o 

Let us now evaluate P{Ef^^J, PiE^j^) and P{EfjJ. 

P{Ef^^^) can be upper bounded as 

PiEt.J = E^(Vi(*i) = Vi|q)P(V3(t3) = V3, Y3 = y3|q) 

(vi,V3,y3,q)GA<"' 

< 2n{H{Vi,V3,Y3\Q)+e)2-n{HiVi\Q)-e)2-n{HiV2,Y3\Q)-e) 

^ 2-"W^i;^3,Y3|Q)-3e)_ 

P{E^j_^) can be upper bounded as 

Pi^tjJ = E^(V3(«3) = V3|q)P(Vi(ti) = VI, Y3 = y3|q) 

(vi,V3,y3,q)eA^"' 

< 2niH{Vi,V3,Y3\Q)+t)2-n{H{V3\Q)-e)2-n{H{VuY3\Q)-t) 

^ 2-"(^(^3;Vi,Y3|(3)-3e)_ 

P{Ef:j_^) can be upper bounded as 

Pi^hO = E^(Vi(*i) = vi|q)P(V3(t3) = V3|q)P(Y3 = y3|q) 

(vi,V3,y3,q)eA<"' 

< 2"W^i.^3,y3|Q)+€)2-"(^^(^i|Q)-e)2-"(^(^3|Q)-e)2-"W>'3|Q)-e) 

^ 2-'»('f(^i'^3;^3|Q)+/(Vi;y3)-4e)_ 

Substituting these in the probability of decoding error at TZ^, we have, 

pH = e + 2"(^3i+/(W;Vi|Q)+4e)2-n(7(yi;V'3,y3|Q)-3e) 
2n{R33+I{W;V3\Q)+4:e)2-n{I(V3;VuY3\Q)-3e) 
2n{R3i+I{W;Vi\Q)+R33+I{W;V3\Q)+8e) 
^2-n{I{Vi,V3;Y3\Q)+I{V,;V3)-4.e) 

In] 

PgV^^ — s- as n ^ 00 if P31 and P33 satisfy the following constraints: 

P31 < /(Vi; V^,Y^\Q) - I{W- Vi\Q), (192) 
P33 < I{V^; Vi,Y^\Q) - I{W- V^\Q), (193) 
P31 + P33 < I{Vi, V^- Y^\Q) + 7(Fi; V^\Q) - I{W- V^\Q) - I{W- Vi\Q). (194) 
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The achievable rate region follows: 

Rii<I{W;UuVi,Y^\Q) (195) 

Ru + R21 < I{W, Uv, Vi,Yi\Q) (196) 

Rii + R3i<I{W,Vv,UuYi\Q) (197) 

Ru + R21 + R31 < I{W, Ui, Vi; Yi\Q) + I{W, Ur, Vi\Q) - I{W; Vi\Q), (198) 

R21 < I{Ur,U2,Y2\Q) - I{W;Ui\Q) (199) 

R22 < IiU2;Ui,Y2\Q) - I{W;U2\Q) (200) 

R2i + R22<I{Ui,U2;Y2\Q) + I{Ui;U2\Q)-I{W;Ui\Q)-I{W;U2\Q), (201) 

R31 < I{Vi; Vs,Y3\Q) - I{W; Vi\Q), (202) 

R33 < I{V3\ Vi,Y3\Q) - I{W- F3IQ), (203) 

R31 + R33 < I{Vi,V3; Y3\Q) + I{Vi; FalQ) - I{W; FglQ) - I{W; Vi\Q). (204) 

This complete the proof of Theorem 4.1. ■ 

V. The Cognitive Gaussian Channel Model 



We introduce now the three-user continuous alphabet cognitive Gaussian channel and derive an achievable rate 
region for this channel. The achievable rate regions described for the discrete memoryless channels can be extended 
to the Gaussian channels by quantizing the channel inputs and outputs [32]. Let Cq denote the cognitive Gaussian 
channel with cumulative message sharing and Cq the cognitive Gaussian channel with primary-only message 
sharing (G for Gaussian, cms and pms are same as before); t = 1,2. We show the extension for only one of the 
channel models - from C^ms to Cq 

The cognitive Gaussian channel is described by an input X^, a corresponding output Yk, and a random variable 
Zk denoting noise at the receiver; k = 1,2,3. The channel is time-discrete unless otherwise specified. Following 
the maximum-entropy theorem [33], the input random variable Xk; /c = 1,2,3 is assumed to have a Gaussian 
distribution. The transmitted codeword Xk = (xfei, ...,Xkn) satisfies the average power constraint given by 

E{||xfcf} <f\; k = 1,2,3, 

where n is the length of the codeword and E{.} is the expectation operator. The zero-mean random variable Zf^ is 
drawn i.i.d from a Gaussian distribution with variance Nk; k = 1,2,3, and is assumed to be independent of the 
signal Xk- The Gaussian CR channel can be converted to standard from using invertible transformations [10], [34]. 

For the channel Cq ^^g, we have W, Ui, U2, Vi and V3 as the random variables (RV) which describe the sources 
at the transmitters. We also some consider some additional RVs - W, U\, U2, Vi and V3 - with the following 
statistics: 
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. ~ A/'(0, APi), 

. ill ~ Ar(0, rPs), U2 ~ A/'(0, rPs), with r + r = 1, 
. Fi ~ AA(0, kPs), 1/3 ~ AA(0, KP3), with k + k = 1. 
Further, 
, W = W, 

• Ui = Ui + aiXi, U2 = U2 + CX2X1, 

. Vi = Vi + asXi + V^? = + "4^1 + 

where the input RV's Xi, X2 and X^ are given by Xi = W, X2 = Ui + U2 and X^ = Vi + V3. Notice that H^, 
ill, U2, Vi and V3 are mutually independent. Therefore, Xi ~ J\f{0, Pi), X2 ~ M{0, P2) and X3 ~ A/'(0, P3). 
The values of r and k are randomly selected from the interval [0,1]. The values of a\, a2, 0:3, 0:4, /3i and /32 are 
repeatedly generated according to A^(0, 1). The channel outputs are 

Yi = Xi + 012X2 + 013X3 + Zi, 
Y2 = 021X1 + X2 + 023X3 + Z2, 
Ys = 031X1 + 032X2 + X3 + Z3, 

where Zi ~ M{0, Qi), Z2 ~ A/^(0, Q2) and Z3 ~ Ar(0, Q3) are independent additive noise. Substituting for Xi, 
X2 and X3, we get, 

Yi = W + ai2{Ui + U2) + 013(^1 + V3) + Zi, 

Y2 = a2iW + {ill + U2) + a23(Vi + F3) + ^2, 
I3 = aziW + az2{Ui + U2) + Vi + % + Z3, 

where the interference coefficients 012, 013, 021, 023, ^31 and 032 are assumed to be real and globally known. The 
rate region '^^s the channel C^^g can be extended to its respective Gaussian channel model by evaluating the 
mutual information terms. To this end, we construct a covariance matrix and compute its entries. These entries will 
be used to compute the differential entropy terms which will further be used to evaluate the mutual information. 
Let us first define a vector 6 as follows: 

e = {Yi Y2 ^3 w Ui U2 Vi V3). 
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The covariance matrix E is given by E = EfS-^G], where E(.) is the expectation operator. 



where ^* represents the matrix-entry of the i row and j column; i 
entries of the covariance matrix follow: 



1 ... 8 and j = 1 ... 8. The individual 



el = E{Y^Y^) = APi + af^Ps + afgPa + Qi 

ei = E{YiY2) = X 

el = E{YiY3) = X 

el = E{YiW) = APi 

el = E{YiUi) = aiAPi + ai2rP2 

el = E{YiU2) = a2\Pi + ai2fP2 

e\ = E{YiVx) = asXPi + aul3iP2 + aia^Ps 

el = E^YiVs) = a^XPi + ai2/32P2 + aia^Ps 

el = E{Y2Yi) = X 
el = E{Y2Y2) = al^XPi + P2 + aigPg + Q2 
ei = E{Y2Ys) = X 
el = E{Y2W) = X 
el = E(Y2Ui) = a2iaiXPi + rP2 
el = E{Y2U2) = a2ia2XPi + f P2 
e^ = E{Y2Vi) = a2ia3APi + /?iP2 + a23KP3 
ei = E{Y2Vs) = X 

ef = E{Y3Yi) = X 
e^ = E{Y3Y2) = X 

el = EiYsYs) = aiiAPi + ai2P2 + P3 + Q3 

el = EiYsW) = 031 APi 

el = E{Y3Ui) = a3iaiAPi + a32rP2 
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el = E(y3C/2) = a3ia2APi + a32rP2 

el = ¥.{Y^Vi) = asiaaAPi + a32^iP2 + kP^ 

el = ^{Y^V^) = asia^XPi + a32p2P2 + RP3 

ef = E{WYi) = APi 
e^ = E{WY2) = X 
el = E{WYs) = 031 APi 
ej = E{WW) = APi 
el = E{WUi) = aiXPi 
ei = E{WU2) = a2APi 
ej = E{WVi) = asXPi 
el = EiWVs) = a4APi 

ef = E{UiYi) = aiXPi + aiarPa 
e^ = E{UiY2) = asittiAPi + TP2 
el = E{UiY3) = asiaiXPi + a32rP2 
el = E{UiW) = aiXPi 
el = E{UiUi) = alXPi+TP2 
el = E{UiU2) = aiaaAPi 
el = E{UiVi) = aiasXPi + ^rPs 
^1 = E{UiV3) = aia^XPi + P2TP2 

ef = E{U2Yi) = a2APi + ai2f P2 
e^ = E{U2Y2) = a2ia2XPi + fPs 
el = EiU2Ys) = asiasAPi + a32rP2 
el = E{U2W) = a2XPi 
el = E{U2Ui) = aia2XPi 
el = E{U2U2) = alXPi + rP2 
e^ = E{U2Vi) = asasAPi + /?irP2 
el = E{U2V3) = a2a4APi + P2fP2 



el = E{ViYi) = asXPi + ai2/3iP2 + ai3KP3 
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el = ¥.{ViY2) = aaiasAPi + + a2znP^ 

el = ECViFs) = a3i«3APi + 032^1^2 + 

el = ¥.{ViW) = a^XPi 

el = ¥.{ViUi) = aiaaAPi + /3itP2 

el = E(ViC/2) = aaaaAPi + /?irP2 

el^ = E(Fiyi) = aiAPi + 0iP2 + KP3 

el = E(Fiy3) = a3a4APi + /3i/?2P2 



el = ¥.{V^Yi) = a^XPi + ai2p2P2 + ai^RP^ 
el = ¥.{V^Y2) = X 

el = ^{VzY^) = a3ia4APi + a32/32P2 + ^Pg 

el = ¥.{V^W) = a^XPi 

el = E(V3C/i) = aia^XPi + /^srPa 

el = E(y3C/2) = a2a4APi + /32rP2 

e^ = ¥.{y^Vi) = asa^XPi + I31P2P2 

el = EiVsVs) = alPi + PIP2 + KP3 

with X representing 'don't care' condition. 

Let r(x) = g. _ iog2^27re) ^ ^jjj express the differential entropy in terms of F and e. 

To compute Pn, Pu + P21, Pii + P31, Pu + P21 + P31: 



hiW\Q) = e + Tiej), hiUilQ) = e + r(^|), h{Vi\Q) = e + r(^^), /i(Yi|Q) = e + T{el 
h{W,Ui\Q) = 2e + T " 



h{Ui,Yi\Q) 
I 



2e + r 



e\ e\ e} 
e\ el ^5 
e\ e\ 6*7 





fl4 /i4 






^4 ^5 


) 


V 












( 




) 









,/i(VF,C/i,C/2|Q) 




/i(T^,c/i,yi|Q) = 3£ + r 



fl6 Q% z)6 
^4 ^5 C/g 

/34 

^4 ^5 ^7 

fl5 fl5 fl5 
f/4 f/5 

^? 



h{W,Ui,Vi,Yi\Q) = Ae + r 



9i ei 



,h{W,Ui,U2,Vi\Q) = Ae + r 



q5 a5 a5 a5 
Ui t/4 ^5 

y el el el e^ 

The mutual information terms are computed as follows: 

I{W- Ui, VuY^lQ) = h{W\Q) + h{Ui, Vi,Yi\Q) - h{W, Ui, VuYi\Q), 
I{W, Ur,VuYi\Q) = h{W, Ui\Q) + h{Vi , I Q) - h{W, UuVi,Yi\Q), 
I{W, Vi;Ui,Yi\Q) = h{W, Vi\Q) + h{Ui , ^ | Q) - h{W, Ui,Vi,Yi\Q), 
I{W- Vi\Q) = h{W\Q) + h{Vi\Q) - h{W, Vi\Q), 
I{W, Ui, U2; Vi\Q) = h{W, Ui, U2\Q) + h{Vi\Q) - h{W, Ui, U2, Vi\Q), 
I{W, Ui, Vi;Yi\Q) = h{W, C/i, Vi\Q) + h{Yi\Q) - h{W, Ui, V^YilQ), 
I{W, Ur, V^\Q) = h{W, Ui\Q) + h{Vi\Q) - h{W, Ui, Vi\Q). 



q4 q4: q4 q4 
6*4 6/g ^7 

el el el e^ 



'6 "7 

q6 n6 n6 nd 

^4 ^5 ^6 ^7 

el el Oq 6*7 



To compute R21, R22 and R21 + -R22: 







el 


el 


2£ + r 
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el 


el 
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2e + T 




ei 


ei 
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el 


el 



h{U2\Q) = e + T{el)My2\Q) = e + T{el), 

,h{Ui,Y2\Q) = 2e + V 

,h{Ui,U2\Q) = 2e + T 
I 



( 


el 


01 




el 


01 




01 


01 


V 


el 


01 



h{Ui,U2,Y2\Q) = ^e + T 



a2 a2 a2 
^2 ^6 

q5 q5 q5 
^2 ^% 

q6 q6 nd 

Wfi 



The mutual information terms are computed as follows: 

I{Ui;U2,Y2\Q) = h{Ui\Q) + h{U2,Y2\Q) " h{Ui,U2,Y2\Q), 
I{W- Ui\Q) = h{W\Q) + h{Ui\Q) - h{W, Ui\Q), 
I{U2;Ui,Y2\Q) = h{U2\Q) + h{Ui,Y2\Q)-h{Ui,U2,Y2\Q), 
I{W; U2\Q) = h{W\Q) + h{U2\Q) - h{W, C/2IQ), 
/(C/i, U2; Y2\Q) = h{Ui, U2\Q) + h{Y2\Q) - h{Uu U2, Y2\Q), 
I{Ur, U2\Q) = h{Ui\Q) + h{U2\Q) - h{Ui, C/2IQ). 



To compute R^q, R33 and R30 + R33: 
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h{V3,Y3\Q) = 2e + T 



01 


01 


01 


01 



hiVslQ) = e + r(^i), h{Y3\Q) = e + T{ 

( 

,/i(yi,y3|g) = 2£ + r 



M^i,^3|Q) = 2£ + r 



M^i>'^"3,>3|Q) = 3£ + r 

The mutual information terms are computed as follows: 

Vz, y?.\Q) = h{Vi\Q) + h{V3, Ys\Q) - h{Vi,V3, Y^IQ), 
I{Vs;Vi,Y3\Q) = hiVslQ) + h{Vi,Ys\Q) - h{Vi,V3,Y3\Q), 
I{Vi,V3;Y3\Q) = h{Vi,V3\Q) + hiY^lQ) - h{VuVs,Y3\Q), 
HVi; Vs\Q) = h{Vi\Q) + h{Vs\Q) - h{Vi,V3\Q), 
I{W, Ui, U2; Vi\Q) = h{W, Ui, U2\Q) + h{Vi\Q) - h{W, U2, Vi\Q), 
I{W, Ui, U2; VslQ) = h{W, Ui, U2\Q) + hiVslQ) - h{W, Ui, U2, F3IQ). 




Theorem 5.1: Let T = (A, r, k, ai, 02, 03, 04, /32). For a fixed T, let Gcmsi'^) be achievable. The rate region 

G,cms 



is achievable for the Gaussian channel Cn with 



^cms 

T 

The same procedure follows for the channels C^^, and C'^g. Without stating the theorem, we outline the 



Gaussian channel equivalent for C^^^. 



For the channel C% we have W, Ui, U2, V\ and V3 as the random variables (RV) which describe the sources 



at the transmitters. We also some consider some additional RVs - W , U\, U2, Vi and V3 - with the following 
statistics: 

. W --Af{0,XPi), 

. Ui ~ AA(0, TP2), U2 ~ AA(0, fP2), with r + f = 1, 
. Vi ~ M{0, kPs), V3 ~ Af{0, RP3), with k + R=1. 
Further, 
, W = W, 
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. Ui = Ui + aiXi, U2 = U2 + 02X1, 

. Vi = Vi + a^Xi, V3 = V3 + 04^1, 
where the input RV's Xi, X2 and X3 are given by Xi = W, X2 = Ui + U2 and X^ = Vi + V^. Notice that W, 
Ui, U2, Vi and V3 are mutually independent. Therefore, Xi M{0, Pi), X2 ^ JV{0, P2) and X3 AA(0, P3). 
The values of r and k are randomly selected from the interval [0,1]- The values of a\, a2, aa, 04 are repeatedly 
generated according to A/^(0, 1). The channel outputs are: 

Yi = Xi + 012X2 + aiaXa + Zi, 
Y2 = a2iXi + X2 + a23X3 + Z2, 

= asiXi + 032^2 + X3 + Z3, 

where Zi ~ A/^(0, Qi), Z2 ~ A/^(0, (^2) and Z3 ~ A/^(0, Qa) are independent additive noise. Substituting for Xi, 
X2 and X3, we get, 

Yi = W + ai2(Ui + U2) + aia(Fi + V3) + ^1, 
y2 = a2iVF + {ill + U2) + a2a(Vi + V3) + ^2, 

= aaiVF + 032(^/1 + 112) + Vi + Vi + Z3, 

where the interference coefficients 012, 013, 021, 023, 031 and 032 are assumed to be globally known. 

We now construct a covariance matrix and compute its entries. This will be used to compute the differential 
entropy terms which will further be used to compute the mutual information terms. Let us first define a vector O 
as follows: 

e = (Fi Y2 Fa W Ui U2 Fi Fa) 
The covariance matrix S is given by S = E[6^6], where E(.) is the expectation operator. 

e\ 02 



where 0^ represents the matrix-entry of the i^^ row and j*'* column; z = 1 . . . 8 and j = 1 ... 8. The individual 
entries of the covariance matrix follow: 



e\ = E(yiyi) = Pi + a\^P2 + al^P^ + Qi 
el = E{YiY2) = X 



el = E{YiYs) = X 

9l = K{YiW) = XPi 

el =E{YiUi)= aiXPi + ai2TP2 

el = E{YiU2) = a2\Pi + ai2fP2 

e\ = E(yiyi) = a^XP^ + a^^nP^ 

el = E(Yiy3) = aiXPi + ai3KP3 



el = E(y2il) = X 

el = E(y2l2) = aiiAPi + P2 + al^P^ + Q2 

el = ¥.{Y2Y^) = X 

el = W.{Y2W) = 021 APi 

el = E(y2?7i) = asiaiAPi + rP2 

el = E(y2f/2) = a2ia2APi + rP2 

02 = E(y2V^i) = a2ia3APi + a23AiP3 

el = ¥.{Y2V^) = X 

el = E(y3yi) = x 
el = nY^Y2) = X 

= E(y3y3) = aiiAPi + ai2P2 + P3 + Qa 
el = E{YsW) = auXPi 
el = E(y3C/i) = a3iaiAPi + a32rP2 
el = E(y3C/2) = a3ia2APi + a32rP2 
e^ = ¥.{Y^Vx) = a^ia^XPi + KP3 
el = E(y3F3) = a^ia^XPi + KP3 



e\ = E(iyyi) = api 

ei = W.{WY2) = 021 APi 

ei = E(wy3) = 031 APi 

e\ = K{WW) = APi 
ei = E{WUi) = aiXPi 
el = K{WU2) = a2XPi 
ej = E{WVi) = asXPi 
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= E{WVs) = a4APi 

el = E{UiYi) = aiXPi + ai2TP2 
el = K{UiY2) = asiaiAPi + rPs 
el = ¥.{UiY^) = aaiaiAPi + a32rP2 
el = E{UiW) = aiXPi 
el = E{UiUi) = alXPi+TP2 
el = lK{UiU2) = aia2XPi 
e^ = E{UiVi) = aiasXPi 
el = EiUiVs) = aia^XPi 

ef = E{U2Yi) = asAPi + ai2fP2 
el = E{U2Y2) = a2ia2XPi + rPg 
el = E(f/2y3) = a3ia2APi + assfPs 
el = E{U2W) = asAPi 
el = E{U2Ui) = aiaaAPi 
el = E{U2U2) = alXPi + rP2 
e^ = E{U2Vi) = aiaaAPi 
^1 = E{U2V3) = a2a4APi 

el = E(FiFi) = aaAPi + aia^Pa 
el = E{ViY2) = a2iaaAPi + a2aKP3 
el = EiV^Ys) = aaiaaAPi + «Pa 
el = E{ViW) = a^XPi 
el = E{ViUi) = ctiaaAPi 
el = E{yiU2) = aiaaAPi 
0? = E(Fiyi) = aiAPi + «Pa 
el = EiViVs) = aaa4APi 

ef = EiVsYi) = a^XPi + aia^Pa 
el = E{V^Y2) = X 
el = EiVsYs) = aaia4APi + RP3 
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el = E{V3W) = a4APi 

= E(V3C/i) = aia^XPi 
el = E(y3U2) = a2a^\Pi 
6»f = EiVsVi) = asOiXPi 
el = EiVsVs) = aim + RP3. 

Let r(x) = ^5S|M and e = ^^ia^ZT?) express the differential entropy in terms of T and e. 

To compute Rii,Rii + -R21, -Rii + ^31, ^11 + R21 + -R31: 



MW^IQ) = e + r(0|), ^(C/i|Q) = e + r(^|), = e + r(e^), /i(Yi|Q) = e + r(^i), 



= 2£ + r 

h{Ui,Yi\Q) = 2e + T 
( 



/ 


ei ei 


) 


V 












( 


el el 


) 




el el 





.h{W,Vi\Q) = 2e + T 



h{Ui,Vi,Yi\Q) = 3s + T 



el el e] 

el el el 
el el el, 




,h{W,Ui,U2\Q) = 3e + T 



h{W,Ui,Vi,Yi\Q) = + T 



3I Ql 



34 /)4 qA 
74 ^7 



h{W,Ui,Vi\Q) = 3e + T 
( 

,/i(T^,i7i,t/2,l^i|Q) = 4£ + r 



0% 

ei 



01 

01 



01 el 



ei e^ 
el e^ 
el eij 



nb q5 ab ob 
Ul ^4 ^5 U-j 

el el el ei, 

The mutual information terms are computed as follows: 

I{W- Ui,Vi,Yi\Q) = h{W\Q) + h{Ui,Vi,Yi\Q)- h{W, Ui,Vi,Y,\Q), 
I{W, Ui; Vi,Yi\Q) = h{W, Ui\Q) + h{Vi,Yi\Q) - h{W, Ui, Vi,Yi\Q), 
I{W, Vi; Ui,Yi\Q) = h{W, Vi\Q) + h{Ui,Yi\Q) - h{W, Ui, Vi,Yi\Q), 
I{W; Vi\Q) = h{W\Q) + h{Vi\Q) - h{W,Vi\Q), 

I{W, Ui, U2; Vi\Q) = h{W, Ui, U2\Q) + h{Vi\Q) - h{W, Ui, U2, Vi\Q), 
I{W, Ui,Vv,Yi\Q) = h{W, Ui,Vi\Q) + h{Yi \ Q) - h{W, UuV^Y^lQ), 
I{W, Ui; Vi\Q) = h{W, Ui\Q) + h{Vi\Q) - h{W, Ui, Vi\Q). 



^4 ^5 

flS nb 

6*4 C/5 

6*4 (^5 

01 01 



el el 
el el 

01 el, 
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To compute R21, R22 and R21 + -R22: 



h{U2\Q) = e + T{el), h{Y2\Q) = e + r(0i), 



h{U2,Y2\Q) = 2e + T 



h{W,U2\Q) = 2e + T 



el 


el 


el 


el 








e\ 


01 


el 





el 


el 


2e + r ^ 








el 


el 




el 


el 


2e + r ^ 








el 


el 



h{W,Ui,Vi\Q) = ^e + V 



a2 q2 q2 

^2 ^& 

q5 q5 q5 

^2 ^5 ^6 

q6 qG q6 

^2 ^5 



The mutual information terms are computed as follows: 

I{Ui; U2,Y2\Q) = h{Ui\Q) + h{U2,Y2\Q) - h{Uu U2,Y2\Q), 

I{W; Ui\Q) = h{W\Q) + h{Ui\Q) - h{W, Ui\Q), 

I{U2\ Ui,Y2\Q) = h{U2\Q) + h{Ui,Y2\Q) - h{Ui, U2,Y2\Q), 

I{W- U2\Q) = h{W\Q) + h{U2\Q) - h{W, U2\Q), 

I{Uu U2; Y2\Q) = h{Ui, C/2IQ) + h{Y2\Q) - h{Ui, U2, Y2\Q), 

I{Ui; C/2IQ) = h{Ui\Q) + h{U2\Q) - h{Ui, C/2IQ). 

To compute R3Q, R33 and R3Q + R33: 



h{V3,Y3\Q) = 2e + T 



^3 ^8 



'3 ^8 



h{V3\Q) = e + r(^i), h{Y3\Q) = e + r(^i), 

fl3 q3 
^3 ^7 

el e] 



,h{VuY3\Q) = 2e + T 
KVi,V3\Q) = 2£ + T 
h{W,Vi\Q) = 2e + T 
h{W,V3\Q) = 2e + T 
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e', el 
e'r el 
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OI ^7 



n el 
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h{Vi,V3,Y3\Q) = 3e + r 




el 



^3 



01 
01 



o\ 



|8 
8 



The mutual information terms are computed as follows: 



I{Vr,V3,Y3\Q) = h{V^\Q) + h{V3,Y3\Q) - h{V^,V3,Y3\Q\ 
I{V3;VuY3\Q) = h{V3\Q) + h{Vi,Y3\Q) - h{V^,V3,Y3\Q), 

/(yi,F3;i3|Q) = h{Vi,V3\Q) + h{Y3\Q) - Kv^.v^^ym, 
I{Vi- VM = h{Vi\Q) + hmQ) - h{yi,V3\Q), 
I{W; Vi\Q) = h{W\Q) + h{Vi\Q) - h{W, Vi\Q), 
I{W\ y^\Q) = h{W\Q) + h{V3\Q) - h{W, F3IQ). 



We consider the 2-user Gaussian cognitive channel with message sharing and the 3-user Gaussian cognitive 
channels with CMS and PMS for the simulations. For simplicity, we assume that the input distributions are Gaussian 
and generate the source and channel symbols as described in the previous page. Also, for ease of generating the 
plots and presenting the results, we focus on two cases: the case where the primary can decode the public part of 
the the messages from CRi and CR2 but not vice versa, and the case where none of the receivers can decode any 
part of the other transmitters' messages. 

• The interference coefficients a\2 = ^13 = ^21 = ^23 = Q-si = 032 - 0.55 

• The values of r and k, are assumed to be randomly selected from the interval [0,1]. 

• The values of ai, 0:2, 03, 04, /3i and (32 are repeatedly generated according to A/^(0, 1). 

• The noise variances Qi = Q2 = Qa = 1- 

• The transmit powers Pi = P2 - P3 =10dB unless otherwise specified. 
B. Details of simulations 

We consider a 3-user Gaussian cognitive channel with CMS and PMS for the simulations. For simplicity we 
assume that the input distributions are Gaussian and generate the source and channel symbols as described in the 
previous page. 

• The interference coefficients 012 = ai3 = 021 = 023 = ^31 = ^32 = 0.55 

• The values of r and n are assumed to be randomly selected from the interval [0,1]. 

• The values of a\, 0:2, a^, 0:4, f3i and (32 are repeatedly generated according to AA(0, 1). 

• The noise variances Qi = Q2 = Qa = 1- 



VI. Simulation Results and Discussion 



A. Setup 
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• The transmit powers Pi = P2 = P3 = 6dB and lOdB as specified. 

C. Simulation results and discussion 

We now present the simulation results and draw several interesting observations. 

1) Figure 2 shows the plot of rate regions for 2-user interference channels with various decoding capabiUty 
combinations. In (a), we consider the case where both receivers cannot decode any message from the non- 
pairing transmitter. In (b), receiver of the primary is allowed to decode the pubhc part of the secondary 
transmitter's message because of which it performs interference cancelation to improve its rate. In (c), both 
receivers (primary and secondary) are allowed to decode the public part of the non-pairing transmitter's 
message so that both can perform successive interference cancelation. Therefore, it achieves the biggest rate 
region. Note that (c) is the Han-Kobayashi achievable rate region for the interference channel [6]. 

2) In Fig.3, we plot the achievable rate regions for the 2-user CR and interference channels. We consider the 
case where both receivers are unable to decode any message from the non-pairing transmitter. It is clear that 
the CR channel has a bigger rate region than the interference channel. The CR's transmitter uses the message 
of the primary to do superposition coding. Therefore, in this particular manner of decoding capability of the 
receivers, we notice that message sharing has a beneficial effect on the achievable rates for both the users 
(primary and the CR). Note that, in all our discussions, we assume that the receivers of the interference 
channel has the same decoding capabihty as that of the corresponding CR channels. 

3) Figure 4 shows the achievable rate regions for the 2-user CR and interference channels with the assumption 
that both the primary and the CR's receiver can decode the public part of the non-pairing transmitter's 
message. It is interesting to notice that while both the primary and the CR benefit from the message-sharing 
mechanism, the maximum achievable rate of the CR (which happens when the rate of the primary is zero, 
Ri = 0) remains the same as it did when the CR could decode part of the message of the primary, but in 
the absence of message-sharing. That is, the same rate is achievable by the CR when i?i = in Figs. 2, 3 
and 4, although the coding schemes are different. This model was introduced and analyzed in [4]. When the 
message-sharing mechanism is disabled, the model reduces to the Han-Kobayashi achievable rate region for 
the interference channel [6], shown in Fig. 2. 

4) In Fig. 5, we plot the achievable rate regions for the 2-user CR and interference channels with the assumption 
that the primary receiver can decode the public part of the CR's message, while the CR's receiver can 
only decode its own messages. The reason for considering this setup is that it corresponds to the decoding 
capabilities assumed in C^^^ and C^^^, in the two-user case. As before, both the primary and the CR benefit 
from the message-sharing operation. An improvement in the primary's rate can be attributed to the fact that 
(i) the CR does superposition coding (using the message from the primary) and (ii) the primary receiver can 
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decode the public part of the CR's message. The figure is also intuitively satisfying, as the achievable rate 
region is very close to that of Fig. 4, which shows that the additional ability of the CR receiver of being able 
to decode part of the primary user's message does not add much to the achievable rate region when the CR 
transmitter has non-causal knowledge of the message of the primary. This model was presented and analyzed 
in [20] for the two-user case, but the comparison with the interference channel and the CR channel with dual 
decoding capabilities presented here provides useful insights. It motivates our choice of decoding capabiUties 
in and C^g, i.e., when the CRs have non-causal knowledge of the message of the primary, allowing 
the CR receivers to be able to decode a part of the primary's message offers only a marginal improvement in 
the achievable rate region. Hence, in the three-user case, we focus on the system models in C^^s ^^'^ ^pms- 
5) In Fig. 6, we plot the achievable rate regions for 3-user CR channels with cumulative message sharing (CMS). 
Similar to our experiments for the 2-user case, we consider two decoding capabilities at the receivers. We 
compare the achievable rate region when the receivers cannot decode the pubHc parts of the other transmitters' 
messages (denoted C^ms ^pms) with the achievable rate region when only the primary transmitter can 
decode the ability to decode the public part of the cognitive transmitters' messages but not vice versa (denoted 
C^jns ^pms)- We notice that the achievable rate region is significantly improved by allowing the primary 
receiver to decode part of the messages from the non-pairing senders. Figure 7 shows the achievable rate 
region for the 3-user CR channel with primary-only message sharing (PMS). Since it is difficult to infer from 
visual inspection, we resort to numerical tabulation of the maximum achievable rates for each of the three 
users, for a better understanding of the performance limits. 

Table V shows the maximum achievable rates of the primary and the two cognitive users, and the maximum 
sum rate achieved under cumulative and primary-only message sharing, and with the two decoding capabihty 
models assumed in this sub-section. Note that the maximum achievable rate for CRi and CR2 are the same 
for C°^5 and C^^ns (^"^ similarly for C^g and C^g), which is as expected, as the decoding capabihty 
of the two cognitive receivers has not been changed. Also, the maximum achievable rate of the primary is 
significantly improved in going from C^ms to ^cms ^om C^g to C^g ), reflecting the benefit of allowing 
the primary receiver to decode part of the other transmitters' messages. Comparing C^^g with C^g we see 
that the maximum rate of CR2 in C^^^s higher than the corresponding rate in C^g, illustrating the benefit 
of allowing CR2 to have non-causal knowledge of CRi's message. The same conclusion can be drawn from 
comparing C^ms with Cp„j3. Finally, notice that the sum rate in C^ms higher than the individual maximum 
rate of any of the users (unlike in the case of C^^s)^ illustrating that although only the primary receiver has 
the additional decoding abihty, in fact, all users have benefited and the rate region has expanded. A similar 
remark can be made by observing Cl^g versus C° ^. 
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VII. Conclusions 

In this paper, we introduced multiuser channels with asymmetric transmitter cooperation and presented two 
different ways of message sharing which we termed cumulative message sharing (CMS) and primary-only message 
sharing (PMS). We modified the chaimel model to introduce rate-splitting and considered different ways in which 
receivers can decode messages. We then derived an achievable rate region for each of the chaimels by employing a 
coding scheme which comprised a combination of superposition and Gel'fand-Pinsker coding techniques. Numerical 
evaluation of the Gaussian case ascertains that the rate regions with CMS is indeed larger than those with PMS, 
and enables finer comparison between the two message-sharing schemes. Future work could include deriving outer 
bounds for the three-user CR channel, which would be useful in determining how close the rate regions derived in 
this paper are to the capacity. 
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Sub-message 


Rate 


Description 


mio € {l,...,2"«i"} 




Rate achieved: <Si -> (7^l,7^2,7^3) 


mil €{1,...,2"«"} 




Rate achieved: <Si — » TZi 


mao G {1,...,2"«^«} 


R20 


Rate achieved: 52 (7?.i, 7?.2, T^-a) 


mai G {l,...,2"-f^2i} 


R21 


Rate achieved: 52 —+ {TZi,TZ2) 


m22 G {l,...,2"-"22} 


R22 


Rate achieved: 52 TZ2 


mao G {l,...,2"«^«i} 


R30 


Rate achieved: 53 {JZi,TZ2,TZ[i) 


mai G {l,...,2"«3i} 


R31 


Rate achieved: 53 (Tl\,TZ3) 


m33G{l,...,2"«33} 


R33 


Rate achieved: 53 — > 7?.3 



TABLE I 

Achievable rates and their description. For ex. is the rate achieved between 5i and TZi, while i?2i is the rate 

ACHIEVED BETWEEN 52, AND 7?.2, 7?.i, ETC. 



Receiver 


Decoding capability 


7^l 


mio, mil, m2o, mso 


7l2 


mio, m2(), m22, m^a 


7^3 


niu), -m2o, TO-30, m33 



TABLE II 

Decoding capability of receivers for the channels Cc^^, C^^^. For ex. receiver Tl^ can decode messages mio, m2o, 

m22, mso 



Receiver 


Decoding capability 


7^l 


mil, m2i, msi 


112 


m2i, m22 


7^3 


msi, m33 



TABLE in 

Decoding capability of receivers for the channels Cc^s, Clms- FOR ex. receiver Tlz can decode messages msi, mas 
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Variable 


Description 


vVo G Vvo 


Public Intormation: oi (/vi, /v2, /vaj 


Wi £ Wi 


Private Intormation: 61 — > TZi 


Uo G Mo 


Public Intormation: 62 ('vi, /v-2, /va) 


(7i G Wi 


Public intormation: 62 ^ (/<.i,7c2) 


U2 G M2 


Private intormation: 02 i-i-2 


Vo G Vo 


Public information: 53 7?.2, TJ-a) 


Vi G Vi 


Public information: 5a {T^i,7i-3) 


14 G V3 


Private information: S3 TZs 



TABLE IV 

Auxiliary Random variables and their description. For ex. Ui denotes public information from 52 decodable at TZi 

AND TZ2 



User & Max. rate achieved (in bps) 


CMS 


PMS 


Channel Model 


^cms 




^pms 




Primary 


0.637 


1.982 


0.637 


1.919 


CRi 


0.897 


0.896 


0.899 


0.889 


CR2 


1.621 


1.616 


0.900 


0.889 


Sum Rate 


1.621 


2.880 


0.900 


2.273 



TABLE V 

Maximum rate that can be achieved by the primary, CRi and CR2 with CMS and PMS and different decoding 
capabilities. Ccms and Cpms correspond to channels with cms and PMS respectively, with none of the receivers 

BEING able to DECODE ANY PART OF THE NON-PAIRING TRANSMITTERS' MESSAGES. 




Fig. 1. Three-user cognitive channel with CMS (left) and PMS (right) 
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1.8 




Fig. 2. Two-user interference channels with different decoding capabilities at the receivers. In (a), both receivers cannot decode any message 
from the unintended transmitter. In (b), the receiver denoted primary can decode public part of the CRi's message. In (c), both receivers 
can decode public part of the message from the unintended transmitter. The power at the transmitters are lOdB. 



1.8 




Fig. 3. Two-user CR and interference channels with both receivers unable to decode any message from the unintended transmitter. 
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1.8 




2.5 



Fig. 4. Two-user CR and interference channels with both receivers being able to decode the public part of the unintended transmitter's 
message. 



1.8 




achievable by primary (bps) 

Fig. 5. Two-user CR and interference channels with the primary's receiver being able to decode the public part of the CR's message. Note 
that the rate region is nearly the same as in Fig.4. 
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Fig. 6. Three-user CR channels with CMS where the receivers cannot decode the message of other users (left), and the primary receiver 
can decode the public part of CRi and CR2 (right). The power at the transmitters is lOdB. 




Fig. 7. Three-user CR channels with PMS where the primary receiver can decode the public part of CRi and CR2 (right). The power at 
the transmitters are 8dB (left) and lOdB (right). 



